Reference: https://devpal.co/blog/web-scraping-with-java-and-htmlunit/ I am doing exactly same steps as mentioned in the blog but getting error java.lang.IllegalArgumentException: Cannot locate dec...

Do you know how can I turn Warnings, Notes, Errors in HtmlUnit off?

I got a problem with a line of code that probably triggers some js function e couse an exception, how can i fix this? box.setText(link.toString()); client.waitForBackgroundJavaScriptStartingBefore...

This question was asked once already, but the API changed I guess and the answers are no valid anymore. URL url = new URL("http://www.example.com"); StringWebResponse response = new StringWebRespo...

I am using htmlunit 2.36.0 in my Android Studio Project. I successfully compiled the apk but I am getting some runtime errors when I try to get a webpage. Before, I was getting the following error:...

I have downloaded htmlunit 2.11 zip. i have extract it. then i have tried to paste them in my project's libs folder. from the libs folder i have added them in build path. then i get this error, whi...

I'm using HtmlUnit in my Java project in order to test a web page that has got Javascript inside. My code clicks a button that calls a Javascript function, wich redirect the user to another page (l...

I have a page that comes back as an UnexpectedPage in HtmlUnit, the response is JSON. Can I use HTMLUnit to parse this or will I need an additional library?

I am writing a code to login onto a website using HtmlUnit. It has been working in eclipse, but now I decided to move it into Android studio use it in an app. I have 2 questions. Why HtmlUnit req...

I am trying to understand testing framework better and been looking into Selenium. I've used HTMLUnit before, mainly when I needed to scrape some information off website or the likes. In the...

How do I go about downloading the image generated at Leaflet easyPrint button using HtmlUnit? I am trying it like this: public static void main(String[] args) { try{ WebClient webClient = new W...

I have got an html page in which the UI is generated using javascript.I am interested in a form which is visible when the page is inspected using developer tools but not in html source. In htmlunit...

I'm using HtmlUnit to interact with a web page that interacts with the server via Ajax. Soon after the Ajax code starts, HtmlUnit produces these two log messages: WARNING: Ignoring XMLHttpRequest....

I have spent a day on researching a library that can be used to accomplish the following: Retrieve the full contents of a webpage like in the background without rendering result to a view. ...

I'm trying to login to Facebook page using HtmlUnit and view its HTML content. I'm trying to fill up the login credentials through HtmlUnit but I don't see the session being carried when the submit...

What is causing this error, and how do I fix it? WebClient webClient = new WebClient(); HtmlPage page = webClient.getPage("http://stackoverflow.com"); Error message May 25, 2013 10:34:12 AM c...

We are in the middle of choosing our headless browser driver solution that will be some implementation of Selenium WebDriver. There is the GhostDriver, which leverages the PhantomJS in the backend ...

Here is my problem, I'm trying to load my website page for testing it but when i look at the html I get from the HtmlUnitDriver, elements displayed with javascript are not present. I am using selen...

I'm using HtmlUnit to generate the HTML for various pages, but right now, the best I can do to get the page into the raw HTML that the server returns is to convert the HtmlPage into an XML string. ...

I am trying to download xls file for a website. When I click the link to download the file, I get a javascript confirm box. I handle it like below ConfirmHandler okHandler = new ConfirmHandler(){...

I wrote a simple web scraper to scrape expedia.com. Using Java Selenium HtmlUnitDriver, i was able to successfully scrape data from the site if i run it locally. However, when i deploy this on to...

I am writing a Java program to log into the website my school uses to post grades. This is the url of the login form: https://ma-andover.myfollett.com/aspen/logon.do This is the HTML of the login...

I am currently learning HtmlUnit in order to scrape websites. Everything went well and smooth until I encountered a dynamic page (as an example, I am using Pinterest website) on which elements are ...

I know that in HtmlUnit i can fireEvent submit on form and it will be posted. But what If I disabled javascript and would like to post a form using some built in function? I've checked the javadoc...

I want to use the Java API, HTMLUnit, to detect the number of eval() calls being called on the webpage by the JavaScript program. However, HTMLUnit doesn't have a built in handler for this type of ...