What should I do if the comments on the e-commerce website cannot be scraped?

Answer:

Some e-commerce websites will restrict the expansion of comment pages, and need to add components in the software to jump.

In smart mode, you need to add the following components on the green button “Pre-executed” interface in the upper right corner first:
Wait + Scroll (set to Scroll one screen height) + Scroll + Wait + Click (select the button to jump to the comment) + Wait

In flowchart mode, add the above components directly.

Is there a free trial for the Professional/Premium plan? How to apply?

Answer:

If you want to apply a free trial, you can write a review for us and we can provide a two-week Professional Plan or an one-week Premium Plan for free.

You can fill in the Review here: https://www.capterra.com/p/176808/ScrapeStorm/

What if the software cannot automatically detect the link?

Answer:

ScrapeStorm usually automatically detects links in web pages, if it can’t, please refer to the tutorial below.

How to scrape a detail page

Can ScrapeStorm scrape data from foreign websites?

Answer:

The principle of ScrapeStorm is similar to copy and paste. In theory, as long as there is data in the web page or source code, it can be scraped.

If the target site can be opened with software, it can theoretically be scraped.

How to solve the problem that the scraping is stopped without all the data being scraped?

Answer:

1. Confirm whether the website requires login. The link copied from the browser will not save the login status, so you need to log in again in the software. Login is performed in the pre-login in the upper right corner of the software.

For more details, please refer to the tutorial:

How to scrape web pages that need to be logged in to view

2. Confirm the data that can actually be viewed on the webpage, not the data that is searched, but the amount of data that can actually be viewed on the webpage. Some websites display tens of thousands of data, but only a few thousand can be viewed in reality. It is recommended to manually jump to the last page to see the actual data volume.

3. Click “Show Page” to confirm the opening status of the webpage when the task is actually running, whether it is restricted, and whether there is a pop-up window.

For more details, please refer to the tutorial:

How to set up Paging

5. If all the data can be viewed on the webpage without being restricted, then it may be a problem with the network speed. The software repeatedly scraped the webpage several times but did not load the webpage. At this time, you can try to set the delay in IP Rotation & Dealy.

6. After all the steps of the appeal have been performed, or not all the data has been scraped, check whether the URL will change as the page number changes. If it will change, directly copy the URL at the end position of the scraping, paste it into the software, and stop The part starts scraping.

For more details, please refer to the tutorial:

How to scrape from breakpoint

Can ScrapeStorm solve captcha automatically?

Answer:

ScrapeStorm does not support solving captcha automatically. But it provides the function of solving captcha manually.

If captcha appears when editing tasks, you can click the blue button in the upper right corner of the software to manually solve captcha.

If there is a captcha when the task is running, usually the software will automatically detect the captcha on the page, and then give a pop-up window prompt. You can manually verify in the pop-up window.

If the captcha prompt pop-up window does not pop up, you can enable “Detect CAPTCHA During the Scraping” in the startup settings to help the software detect captcha, and then manually verify.

Tips: When the software automatically detects captcha and pops up a prompt during operation, the task will be suspended. After manual verification, the software will continue to run the current task. In addition, there is a probability of misidentification in automatic detection. If you judge that there is no captcha on the page, just click “Skip”. After skipping twice in a row, the software will no longer detect the captcha.

How to solve the problem that the website needs a VPN to access?

Answer:

ScrapeStorm’s built-in browser accesses web pages, which is the same as using a normal browser to access web pages. If the website needs a VPN to access, then you need to use the VPN on the local computer now, and then use ScrapeStorm for data scraping.

Can ScrapeStorm scrape phone numbers?

Answer:

Phone numbers are sensitive information, and ScrapeStorm cannot help you with this type of data scraping.

Can ScrapeStorm scrape email address, user browsing data, seller information or customer data?

Answer:

In theory, as long as there is data on the web page or in the source code, it can be scraped.

However, the email address, user browsing data, seller information, customer data and other data you need are sensitive data, and ScrapeStorm does not provide any form of guidance.

Can ScrapeStorm scrape the data of a certain industry?

Answer:

Yes, ScrapeStorm is a software for scraping webpage data. Therefore, it is first necessary to clarify which website the industry data exists on.
For example, the data of the e-commerce industry is on the e-commerce website, so scraping the data of the e-commerce industry is transformed into scraping the e-commerce website.

Tips: In order to protect your privacy, all your tasks and configurations are stored in the cloud in an encrypted form, and no one but you can view the specific content. The account password you entered during the scraping process and your collection results are stored on your local computer. But please strictly abide by the relevant laws and regulations. If ScrapeStorm officially receives any reports about illegal scraping, the account will be blocked immediately.