Data Export – Scrapestorm https://www.scrapestorm.com AI Driven Web Scraping Fri, 27 May 2022 02:16:09 +0000 zh-CN hourly 1 https://wordpress.org/?v=6.0 https://www.scrapestorm.com/wp-content/uploads/2018/01/cropped-home_icon-19-2-32x32.png Data Export – Scrapestorm https://www.scrapestorm.com 32 32 How to set up Data Migration https://www.scrapestorm.com/tutorial/how-to-set-up-data-migration/ Wed, 13 May 2020 07:35:12 +0000 https://www.scrapestorm.com/?type=post&pid=7828 Data migration is the process of backing up and migrating data, because after upgrading the software to version 4.x, the current software settings and scraped data will be lost.

 

After the official release, when you click the upgrade button, the data migration interface will automatically pop up. Since version 4.x has not yet been released, this tutorial will guide you through the data backup by clicking the version number on the software taskbar.

]]>
How to export data to WordPress https://www.scrapestorm.com/tutorial/export-to-wordpress/ Wed, 10 Apr 2019 09:03:44 +0000 http://www.scrapestorm.com/?type=post&pid=5515 This tutorial consists of five steps: installing the plugin —> opening the export interface —> setting up the task —> setting the field mapping —> publishing to the website

Step 1:

Click here to learn how to download and install the WordPress plugin.

Step 2: 

Open the export interface and click Publish to the website “WordPress”.

Step 3:

Select Configuration, you can create a new configuration, or use a previously saved configuration.

When creating a new configuration, enter the home URL (must be a remotely accessible external network address), wordpress plugin password.

The software will automatically identify whether the URL and publish password are correct. If the plugin is not installed successfully or the password is incorrect, first check whether the plugin is installed correctly, and second, check whether the correct URL and password are entered.
Some users will enter the login password of the webmaster into the publish password, please pay attention to this.

When choosing a post status, we can choose to publish directly or save as draft.

When choosing protection, we can choose to be public or private.

Step 4:

After all settings are complete, click the “Next” button to set the field mapping.

When you set up a field map, you can publish the field to a specified location, or you can publish the field to a different location according to your needs.

Step 5:

After the field mapping settings are completed, click the “Next” button to make export settings.

In the export interface, you can choose to manually export or automatically export.

When you choose to export manually, you can choose to export all unexported rows, or export selected rows, or even choose to export data in scope.

If you use Automatic Export, the software will launch a separate export task to export all the data, including new data scraped in real time.

P.S. Automatic Export can only be used by users of Premium Plan and above. Combined with the Schedule function, it can greatly save user time and improve efficiency.

Step 6:

Once the export format is selected, click the “Export” button to export the data.

If the export is correct, the log of the number of exports will appear directly.

If the export is incorrect, the running log will prompt the export to fail. If the red text prompt appears, you can check if the field mapping settings are correct.

After the export is successful, a bullet box will appear, and the user can choose whether to mark.

If you can export normally before, you can mark the data normally and the corresponding number of markers will appear.

If the previous export failed, the data will not be marked normally at this time, and the number of markers will be displayed as 0.

]]>
How to install WordPress plugin https://www.scrapestorm.com/tutorial/how-to-install-wordpress-plugin/ Wed, 10 Apr 2019 09:03:05 +0000 http://www.scrapestorm.com/?type=post&pid=5508 This tutorial consists of two steps: downloading the plugin –> installing the plugin

Step 1: Download the plugin

Click here to download the installation file for the plugin.

You can also click this button in the export interface to download.

Step 2: Insatall the plugin

1. After the plug-in is downloaded, the file is uploaded and decompressed to the “wp-content/plugins” directory of WordPress website using FTP. If you need to update the plug-in, the method is the same.
2. After the file upload is completed, login to the background of WordPress website with the administrator account.

3. Enter the background of the website and open the “Plugins” -> “Installed Plugins”. As you can see, the ScrapeStorm plugin has been successfully installed.

4. Activate the plugin and the “ScrapeStorm” module will appear in the menu bar.

5. Open the module to view basic information, modify the password, etc.

Note: After installing the plugin, please click here to view the release tutorial on how to publish data to the WordPress site.

]]>
How to export data to MongoDB https://www.scrapestorm.com/tutorial/export-to-the-database-mongodb/ Mon, 08 Apr 2019 12:10:59 +0000 http://www.scrapestorm.com/?type=post&pid=5420 ScrapeStorm provides a variety of export methods. If you need to export the scraped data to MongoDB, you can export it as follows.

Step 1:
After the data is scraped, select Mongodb option on the export interface.

Step 2:
Select a database to create a new configuration or use a previously configured database.

When creating a new configuration, first select the database type, then enter the server, port, log-in name, password and DB name.

If the input is incorrect, an error will appear. At this time, you need to check whether the server, port, log-in name, password and DB name are correctly entered.

If you enter them correctly, the DB Table will appear.

Then the user can choose the DB Character, there are two choices: utf8 and gbk.

Step 3:

After all settings are complete, click the “Next” button to make the export settings.

In the export interface, you can choose to manually export or automatically export.

When you choose to export manually, you can choose to export all unexported rows, or export selected rows, or even choose to export data in scope.

If you use Automatic Export, the software will launch a separate export task to export all the data, including new data scraped in real time.

P.S. Automatic Export can only be used by users of Premium Plan and above. Combined with the Schedule function, it can greatly save user time and improve efficiency.

Step 4:

Once the export format is selected, click the “Export” button to export the data.

If the export is correct, the log of the number of exports will appear directly.

After the export is successful, a bullet box will appear, and the user can choose whether to mark.

Step 5:

The effect of exporting to the database is as follows:

 

]]>
How to export data to PostgreSQL https://www.scrapestorm.com/tutorial/export-to-the-database-postgresql/ Thu, 04 Apr 2019 08:12:44 +0000 http://www.scrapestorm.com/?type=post&pid=5400 ScrapeStorm provides a variety of export methods. If you need to publish the scraped data to PostgreSQL, you can export it as follows.

Step 1:
After the data is scraped, select PostgreSQL option on the export interface.

Step 2:
Select a database to create a new configuration or use a previously configured database.

When creating a new configuration, first select the database type, then enter the server, port, log-in name and password.

If the input is incorrect, an error will appear. At this time, you need to check whether the server, port, log-in name and password are correctly entered.

If you enter them correctly, the DB Name will appear at this time. After selecting the DB Name, the DB Table will appear accordingly.

Then the user can choose the DB Character, there are two choices: utf8 and gbk.

Step 3:

After all settings are complete, click the “Next” button to set the field mapping.

ⅰ. If the single data published to the database is too large, it may cause the publishing to fail. In this case, you can adjust the parameters such as the size and connection time of the database buffer.

ⅱ. To ensure that the data can be released normally, please check if your database field type can store the data of the corresponding field (the default is text type).

ⅲ. The data target field is unique, and the duplicate setting field cannot release data normally.

Step 4:

After the field mapping settings are completed, click the “Next” button to make export settings.

In the export interface, you can choose to manually export or automatically export.

When you choose to export manually, you can choose to export all unexported rows, or export selected rows, or even choose to export data in scope.

If you use Automatic Export, the software will launch a separate export task to export all the data, including new data scraped in real time.

P.S. Automatic Export can only be used by users of Premium Plan and above. Combined with the Schedule function, it can greatly save user time and improve efficiency.

Step 5:

Once the export format is selected, click the “Export” button to export the data.

If the export is correct, the log of the number of exports will appear directly.

If the export is incorrect, the running log will prompt the export to fail. If the red text prompt appears, you can check if the field mapping settings are correct.

After the export is successful, a bullet box will appear, and the user can choose whether to mark.

If you can export normally before, you can mark the data normally and the corresponding number of markers will appear.

If the previous export failed, the data will not be marked normally at this time, and the number of markers will be displayed as 0.

Step 6:

The effect of exporting to the database is as follows:

]]>
How to export data to SQLServer https://www.scrapestorm.com/tutorial/export-to-the-database-sqlserver/ Thu, 04 Apr 2019 08:12:19 +0000 http://www.scrapestorm.com/?type=post&pid=5379 ScrapeStorm provides a variety of export methods. If you need to publish the scraped data to SQLServer, you can export it as follows.

Step 1:
After the data is scraped, select SQLServer option on the export interface.

Step 2:
Select a database to create a new configuration or use a previously configured database.

When creating a new configuration, first select the database type, then enter the server, port, log-in name and password.

If the input is incorrect, an error will appear. At this time, you need to check whether the server, port, log-in name and password are correctly entered.

If you enter them correctly, the DB Name will appear at this time. After selecting the DB Name, the DB Table will appear accordingly.

Then the user can choose the DB Character, there are two choices: utf8 and gbk.

Step 3:

After all settings are complete, click the “Next” button to set the field mapping.

ⅰ. If the single data published to the database is too large, it may cause the publishing to fail. In this case, you can adjust the parameters such as the size and connection time of the database buffer.

ⅱ. To ensure that the data can be released normally, please check if your database field type can store the data of the corresponding field (the default is text type).

ⅲ. The data target field is unique, and the duplicate setting field cannot release data normally.

Step 4:

After the field mapping settings are completed, click the “Next” button to make export settings.

In the export interface, you can choose to manually export or automatically export.

When you choose to export manually, you can choose to export all unexported rows, or export selected rows, or even choose to export data in scope.

If you use Automatic Export, the software will launch a separate export task to export all the data, including new data scraped in real time.

P.S. Automatic Export can only be used by users of Premium Plan and above. Combined with the Schedule function, it can greatly save user time and improve efficiency.

Step 5:

Once the export format is selected, click the “Export” button to export the data.

If the export is correct, the log of the number of exports will appear directly.

If the export is incorrect, the running log will prompt the export to fail. If the red text prompt appears, you can check if the field mapping settings are correct.

After the export is successful, a bullet box will appear, and the user can choose whether to mark.

If you can export normally before, you can mark the data normally and the corresponding number of markers will appear.

If the previous export failed, the data will not be marked normally at this time, and the number of markers will be displayed as 0.

Step 6:

The effect of exporting to the database is as follows:

]]>
How to export data to MySQL https://www.scrapestorm.com/tutorial/export-to-the-database-mysql/ Thu, 04 Apr 2019 08:12:01 +0000 http://www.scrapestorm.com/?type=post&pid=5356 ScrapeStorm provides a variety of export methods. If you need to export the scraped data to MySQL, you can export it as follows.

Step 1:
After the data is scraped, select MySQL option on the export interface.

Step 2:
Select a database to create a new configuration or use a previously configured database.

When creating a new configuration, first select the database type, then enter the server, port, log-in name and password.

If the input is incorrect, an error will appear. At this time, you need to check whether the server, port, log-in name and password are correctly entered.

If you enter them correctly, the DB Name will appear at this time. After selecting the DB Name, the DB Table will appear accordingly.

Then the user can choose the DB Character, there are two choices: utf8 and gbk.

Step 3:

After all settings are complete, click the “Next” button to set the field mapping.

ⅰ. If the single data published to the database is too large, it may cause the publishing to fail. In this case, you can adjust the parameters such as the size and connection time of the database buffer.

ⅱ. To ensure that the data can be released normally, please check if your database field type can store the data of the corresponding field (the default is text type).

ⅲ. The data target field is unique, and the duplicate setting field cannot release data normally.

Step 4:

After the field mapping settings are completed, click the “Next” button to make export settings.

In the export interface, you can choose to manually export or automatically export.

When you choose to export manually, you can choose to export all unexported rows, or export selected rows, or even choose to export data in scope.

If you use Automatic Export, the software will launch a separate export task to export all the data, including new data scraped in real time.

P.S. Automatic Export can only be used by users of Premium Plan and above. Combined with the Schedule function, it can greatly save user time and improve efficiency.

Step 5:

Once the export format is selected, click the “Export” button to export the data.

If the export is correct, the log of the number of exports will appear directly.

If the export is incorrect, the running log will prompt the export to fail. If the red text prompt appears, you can check if the field mapping settings are correct.

After the export is successful, a bullet box will appear, and the user can choose whether to mark.

If you can export normally before, you can mark the data normally and the corresponding number of markers will appear.

If the previous export failed, the data will not be marked normally at this time, and the number of markers will be displayed as 0.

Step 6:

The effect of exporting to the database is as follows:

]]>