How to capture dynamic data page

2010-07-27  来源:本站原创  分类:Tech  人气:216 

First of all, I am referring to dynamic data clearly what.

Definitions: dynamic data here refers to the dynamic pages generated by the Javascript page content, or Web page source file does not, the page is loaded into the browser dynamically generated.

The following to business.

Simple static pages to crawl through the Java access to the html source code, then analyzes the source code you can get the desired information. Such as access to Hangzhou, China weather network weather, only to find the corresponding html page ( http://www.weather.com.cn/weather/101210101.shtml ).

If I need to enter the city name for the city to change the weather data source or the use of Chinese weather network. The first step is to find the corresponding page according to the city. Simple analysis shows that the city has the corresponding URL with the page, such as the corresponding 101 210 101 Hangzhou, so the key is to find the program correspondence between the city and the page.

Found that the site search box are links to most cities in China, can be correspondence between the city and _id. To find a breakthrough, into action. Into the home, view its source code, find the search box location.

How to capture dynamic data page

The original data is dynamically added to the list through the Javascript with Chrome's inspect element see the following.

How to capture dynamic data page

Can do now is to use Chrome to copy the html file and then parse the file by the city and the URL of the relationship. The problem is if the site URL corresponding relationship between the city and there are changes, this is a passive process needs to change.

The question now is how to get Java Javascript dynamically generated html content, I do not know what the views.

相关文章
  • How to capture dynamic data page 2010-07-27

    First of all, I am referring to dynamic data clearly what. Definitions: dynamic data here refers to the dynamic pages generated by the Javascript page content, or Web page source file does not, the page is loaded into the browser dynamically generate

  • How to capture the dynamic data page 2010-07-27

    First of all, I am referring to dynamic data clearly what. Definitions: dynamic data here refers to the dynamic pages generated by the Javascript page content, or Web page source file does not, the page is loaded into the browser dynamically generate

  • Struts2 dynamic data validation on the echo problem 2010-04-28

    struts2 for the server-side validation, can be used two kinds of, 1: rewrite the validate method, 2: The validate framework, let us look at validate method, the following diagram as an example. Figure marital status and gender requirements dynamicall

  • 2010.03.11 (3) - FusionChartsFree get it from the background data and dynamic data source 2009-08-01

    2010.03.11 (3) - FusionChartsFree get it from the background data and dynamic data source To do this today from the inside, learned two important points, 1. So that there is always a check box is check the // Judge check box must be at least one item

  • jQuery plug-ins page peel AD Dynamic Volume page. flip or roll angle flash advertising effectiveness 2009-10-01

    jQuery plug-ins page peel AD Dynamic Volume page. flip or roll angle flash advertising effectiveness

  • FROM dynamically load data page 2010-06-04

    FROM dynamically load data page After the show you want to open the page the background data can be achieved in two ways 1, point the URL to the menu when the menu is XX.do methods in this way in return the object and page 2 EXT page hit the LOAD FRO

  • C # apply the template output Excel, and the data page (collection) 2010-10-18

    using System; using System.IO; using System.Data; using System.Reflection; using System.Diagnostics; using cfg = System.Configuration; using Excel; namespace ExcelHelperTest { / ** / / / / <summary> / / / Function: apply the template output Excel, a

  • [Ext extension] dynamic page size. Dynamic grid height. Triad local data page 2010-04-27

    Ext.ux.plugins.PageComboResizer: PagingToolbar plug-in, add a page to provide the size of the ComboBox selection Details visit: http://www.bewareofthebear.com/ext-js/ext-js-pagingtoolbar-pageresizer/ Ext.ux.data.PagingStore: Extension Store, providin

  • JSP dynamic web page programming (I) 2010-03-29

    JSP (JavaServer Pages): JSP pages from the traditional form of web pages is HTML file to add Java program fragment (Scriptlet), and JSP tags. Servlet / JSP container received a request issued by the client, the first implementation of the program in

  • Small packet capture tool HttpWatch page 2010-04-28

    HttpWatch main function is sent through the browser to monitor and analyze http request, when you browser's address bar an URL or submit a request form,, HttpWatch help you analyze the http request of the head information, visit cookie information pa

  • Ext simple application (a)-SSH2 + Ext2 data page display 2009-10-20

    I wrote a relatively simple demo, but the most simple query page, after the change will continue to increase functionality. IE7 and Firefox through testing. Or please view the specific code is better. Ext for the use of the preparatory work needed in

  • Android to capture tcp data packets under 2010-04-20

    If you want to grab a TCP packet , We can use TCPdump tool , The specific method is Download the tcpdump, each address is http://www.strazzere.com/android/tcpdump, Don't know the specific version . Detailed usage please refer to the http://www.tcpdum

  • OpenFlashChartDemo dynamic data display 2010-10-23

    <%@ page language="java" import="java.util.*" pageEncoding="UTF-8"%> <html> <script type="text/javascript" src="<%=request.getContextPath() %>/ofc2/swfobject.js"></script> <

  • Oracle database based on the principle of data page 2010-12-31

    Been feeling a demand paging is a difficult but yet had to spend some time pondering pondering, but also figure out a little hall, now thought to share with you. Page Principle: Page shows the results of the database is a set of artificial segments b

  • Based on principles of Oracle database data page 2010-12-31

    Paging is a need has been felt, but yet is a difficult and had to spend some time pondering pondering, but also figured out a little hall, now thought to share with you. Page Principle: Pagination is the database result set into a section of the arti

  • Adox create a dynamic data table 2010-06-09

    Adox support all versions of the data type format Constant Value 3.51 jet 4.0 jet SQL 7.0 adBinary 128 Be Be Be adBoolean 11 Be Be Be adChar 129 Be No Be adCurrency 6 Be Be Be adDate 7 Be Be No adDouble 5 Be Be Be adGUID 72 Be Be Be adInteger 3 Be Be

  • 5.3 Dynamic master page loads 2011-05-09

    Master page dynamically loaded applications: 1) by loading a different master page that allows website users to customize the appearance of 2) need their own Web site co-branding with partners of the site looks the same, so that the user from the par

  • Ask how to maintain state of the data page list maintained? 2011-05-18

    Consult a technical issue to you a list of query processing by a combined list of data you can click into view a single record, see end of this record and want to return to check out just a list of combinations, check out how to keep a list of state

  • WEB dynamic data integration 2010-12-02

    Data

  • Oracle, SQL Server, My SQL query summary data page 2011-03-05

    Until learning SQL Server, but the paging query is extremely complex. So bite the bullet and back down. Today, when using My SQL has been in error. Looking for half an hour, and later posted on the Internet I realized, My SQL can not be used. So put