|
|
|
|||
[<<< Back, to the category overview]
Add to the basket for $99 US dollars
Internet Data Extractor 1.0 (~420 Kb) $99
The program downloads a website and parses the html code and puts the result
into a table. This table can be saved as CSV file (can be opened in Excel
for example).
You can create a pascal script which can download websites, parses the table entries (read and write from the table) and for example following the links to collect detail information. The pascal script can save the result as CSV file. It is no problem to extract the needed information. Lets say you want to download all information available for a list of stocks and do some calculation and output the result as Excel table. Or you want to extract all addresses from a list of addresses on a website and put them into a data base. Once the script is created and runs well you can call the program with the script file name as parameter and the program will extract all information in the background.
This program can save you a lot of money, as it can automate tasks and save many man working hours!
For example on wWikipedia: Pascal as programming language.
All types are variant types.
An example script is:
var i,e;
begin
e:=0;
for i:=1 to 100 do begin
e:=e+getcell(i,1);
end;
end;
A real world example is available in the file comdirect.pas. This file will download all detail information of all 30 German DAX stocks and saves each one in a separate csv file on hard disk. The information is readed from the German website http://www.comdirect.de
resulturl:=Download(url,baseurl);
This will follow the link "url" and uses "baseurl" as main html document. If "url" is a complete URL, baseurl can be empty. The resulturl is the url which the program has build from url and baseurl and actually downloaded. The result of the download process will be saved in the main table.
Examples:
download('http://www.cadkas.com','');
resulturl:=download('/next.htm','http://www.cadkas.com/test.htm');
resulturl will be http://www.cadkas.com/next.htm in this case.
This is needed because the link inside the html file will often be relative links. And if you need to follow the links you will need the baseurl and the relative link.
SaveTable('name.csv');
This command will save the actual main table under the file name specified.
Examples:
savetable('test.csv');
savetable('stock'+inttostr(i)+'+.csv');
GetCell(column,row);
This command will return the value saved in the given table cell.
Examples:
s:=GetCell(1,2); s:=GetCell(i+1,e);
SetCell(column,row,newvalue);
This command will save a new value saved in the given table cell.
Examples:
SetCell(1,2,'test'); SetCell(i+1,e,s);
ClearCells;
This command will clear the main table.
Examples:
ClearCells;
var:=VarArrayCreate(numberofentries);
This command will create an array in which you can store information.
Examples:
var s; begin s := VarArrayCreate(91); s[0]:='test'; s[90]:='test 90'; s[91]:='test';//this is invalid end;
|
|||