Retrieving and sending cookies with HttpDownload

The table function HttpDownload@DataDictionary allows retrieval of a specific URL using a variety of parameters:

An alternative for retrieving all pages of a website is internettable (see Hoe download ik automatisch alle documenten van een website? (Dutch)).

Sending Cookies

Cookies values can be send to the URL using the parameter cookies.

The cookie names and values must be provided in an URL encoded format similar to headers (see How to send multiple key values in Authorization header with httpdownload): the key and value are separated by an equals sign, and pairs are separated by an ampersand.

For example, two cookie key/value pairs could read:

session=my-session-id&AS=12345

Retrieving Cookies

The values of cookies set by the website can be retrieved from the table HttpDownloadCookiesHistory@DataDictionary.

First memorize the value of uid returned by HttpDownload@DataDictionary.

Then retrieve the cookies using:

select *
from   HttpDownloadCookiesHistory@DataDictionary
where  download_uid = :uidfound

Availability

Exchange of cookies is available starting release 24.0.260 of Invantive UniversalSQL.