Forum

How to parse HTML page to import a table daily?

Nov 20, 2012 10:07 AM

Active user

Points:: 0
Joined:: Sep 27, 2011

Hello!
I need to load a page from a site, parse it and get a data from a table.
Currently I am using a field of HTMLDocument type on a form and made a simplified html page:

Code

<html>
<head></head>
<body>
<div>
<table id="dataTable">
<tbody>
<tr><td>10</td><td>72</td><td>13</td></tr>
<tr><td>12</td><td>23</td><td>36</td></tr>
<tr><td>13</td><td>22</td><td>32</td></tr>
</tbody>
</table>
</div>
</body>

Here are the questions:
How can I get the table content parsed as a table?
How can I make it work in a scheduled task daily?

Profile

Samuel Harris

Nov 20, 2012 06:30 PM

Active user

Points:: 32
Joined:: Sep 16, 2011

Hi!

Here is the script for your form:

Code

&AtClient
Procedure Parse(Command)
   Items.HTMLDocument.Document.location.href="http://domain.com/path/file.html";
   ParsingRequired = True;
EndProcedure

&AtClient
Procedure HTMLDocumentDocumentComplete(Item)
   If Items.HTMLDocument.Document.readyState = "complete" And ParsingRequired Then
      For Each tr In Items.HTMLDocument.Document.all["dataTable"].firstChild.children Do
         For Each td In tr.children Do
            UserMessage = New UserMessage;
            UserMessage.Text = td.innerText;
            UserMessage.Message();
         EndDo;
      EndDo;
      ParsingRequired = False;
   EndIf;
EndProcedure

Profile

Eric Kruger	#3 Nov 21, 2012 09:27 AM
Active user Points:: 0 Joined:: Sep 27, 2011	Thanks a lot, Samuel! And what about how to execute this operation daily?
	Profile

ivan avdonin	#4 Nov 21, 2012 10:17 AM
Active user Points:: 0 Joined:: Sep 26, 2012	I think, for this "Scheduled Jobs" can help. there is Service subsystem "Scheduled Jobs" at "1C:Subsystems Library" there is a chapter 5.5.9.3 at documentation
	Profile

Eric Kruger	#5 Nov 21, 2012 11:28 AM
Active user Points:: 0 Joined:: Sep 27, 2011	Thanks, Ivan. But if a scheduled job can open a form with HTML document field and execute a command?
	Profile

ivan avdonin	#6 Nov 21, 2012 11:42 AM
Active user Points:: 0 Joined:: Sep 26, 2012	For thin client I would use method of ManagedForm AttachIdleHandler(<ProcedureName>, <Interval>, <Single>)
	Profile

Eric Kruger	#7 Nov 21, 2012 11:50 AM
Active user Points:: 0 Joined:: Sep 27, 2011	Thus I will have to run an application to emulate a scheduled job... If there is a way to use DOM at server in scheduled job?
	Profile

ivan avdonin

Nov 21, 2012 12:58 PM

Active user

Points:: 0
Joined:: Sep 26, 2012

There is object HTTPConnection at server. For using it, you need to know name of getting file.

Code

inputFile= TempFilesDir()+"input.txt";
НТТР = New HTTPConnection("domain.com",,,,); 
НТТР.Get("/path/file.html", inputFile); 
textFromFile = New TextDocument;
textFromFile.Read(inputFile);
html = textFromFile.GetText();

at variable "html" you will have html script, which you can put to HTMLDocument field

Profile

Xin Wang	#9 Nov 21, 2012 01:13 PM
Active user Points:: 2 Joined:: Sep 16, 2011	And maybe XMLReader could help to parse this text using DOM...
	Profile

Xin Wang	#10 Dec 04, 2012 03:35 PM
Active user Points:: 2 Joined:: Sep 16, 2011	Or HTMLDocumentShell, method GetHTMLDocument...
	Profile