Node Js | Simple Crawling Data Insert to DB Part 3

Welcome to the third part of our tutorial series on Node Js! In this tutorial, we will continue our discussion on crawling data and inserting it into a database using Node Js. If you haven’t checked out the previous parts, make sure to do so before proceeding with this tutorial.

Prerequisites

Before we start, make sure you have Node Js and a database system like MySQL or MongoDB installed on your machine. Additionally, you should have a basic understanding of JavaScript and asynchronous programming in Node Js.

Connecting to the Database

First, we need to establish a connection to our database. Depending on the database system you are using, the connection process may vary. Here’s an example of how you can connect to a MySQL database using the `mysql` package:

“`javascript
const mysql = require(‘mysql’);

const connection = mysql.createConnection({
host: ‘localhost’,
user: ‘username’,
password: ‘password’,
database: ‘dbname’
});

connection.connect((err) => {
if (err) {
console.error(‘Error connecting to database’);
return;
}
console.log(‘Connected to database’);
});

// Use the connection to execute queries
“`

Inserting Data into the Database

Once we have established a connection to the database, we can start inserting the crawled data into it. Suppose we have an array of objects `data` containing the data we want to insert. We can use the following code to insert this data into a table called `my_table`:

“`javascript
data.forEach((item) => {
connection.query(‘INSERT INTO my_table SET ?’, item, (err, result) => {
if (err) {
console.error(‘Error inserting data’);
return;
}
console.log(‘Data inserted successfully’);
});
});
“`

Conclusion

That’s it for this tutorial! We have learned how to connect to a database and insert crawled data into it using Node Js. In the next part of this series, we will cover how to handle errors and optimize the data insertion process. Stay tuned!