无法使用硒javascript获取Div的全文（至页面末尾）

Question

        List <WebElement> divList = driver.findElements(By.cssSelector("#graphiql-container > div.editorWrap > div.editorBar > div.resultWrap > div > div > div.CodeMirror-scroll"));
        List<WebElement> elements= driver.findElement(By.cssSelector(
                "#graphiql-container > div.editorWrap > div.editorBar > div.resultWrap > div > div > div.CodeMirror-scroll"))
                .findElements(By.xpath(".//*"));
        for (WebElement webElement : elements) {
            System.out.println(webElement.getText());
        }

I am using above code to get the entire text of particular div, however the string here return only visible text,however there is still more data till the end of page , it does not return it. Is there any way we can achieve it ?. Putting in a nutshell i want to get full text of specific section of webpage till the end.

Answer 1

Here is my recently finished Java HTML Scrape Package. Note, this is not javascript, but java.

http://developer.torello.directory/JavaHTML/index.html

This provides a really simple way to interact with HTML pages that are "Content Driven" on a website. Uses Regular Expressions to convert Raw-HTML into a simple java Vector.

To get the "Text" of any "DIV" node in an HTML-page.

import Torello.HTML.*;

public class Scrape
{
  public static void main(String[] argv) throws IOException
  {
    Vector<HTMLNode> page = HTMLPage.getPageTokens(new java.net.URL("Your-URL"), false);
    int pos = InnerTagFind.first(page, "div", "class", TextTester.EQ, "div-class-constraint");
    HTMLNode n;
    // This will print all Text that follows the particular HTML <DIV CLASS="...">
    // View the scrape class documentation for other functions.
    for (int i=pos; i < page.size(); i++)
      if ((n = page.elementAt(i)) instanceof TextNode)
        System.out.println(n.str);
  }