Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vivekananda_session1_4VP20CS072_Rakshith Raj V #73

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions Vivekanada_session1_4VP20CS072_Rakshith Raj V/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
FROM python:3.10.2-alpine3.15
# Create directories
RUN mkdir -p /root/workspace/src
COPY ./hw.py /root/workspace/src
# Switch to project directory
WORKDIR /root/workspace/src
# Install required packages
RUN pip install --upgrade pip
RUN pip install requests bs4 html5lib
23 changes: 23 additions & 0 deletions Vivekanada_session1_4VP20CS072_Rakshith Raj V/connection.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
import psycopg2
import csv
conn = psycopg2.connect(
host="172.17.0.2",
port="5432",
dbname="hw1",
user="postgres",
password="123456"
)

cur = conn.cursor()

with open('output2.csv','r') as f:
csv_reader = csv.reader(f)
next(csv_reader)
for row in csv_reader:

cur.execute("INSERT INTO blog_data1 (column1, column2, column3) VALUES (%s, %s, %s)",(row[0], row[1],row[2]))

conn.commit()

cur.close()
conn.close()
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
psql-db:
image: 'postgres:14'
container_name: psql-db1
environment:
- PGPASSWORD=123456
- POSTGRES_USER=postgres
- POSTGRES_PASSWORD=123456
ports:
- '5434:5432'
9 changes: 9 additions & 0 deletions Vivekanada_session1_4VP20CS072_Rakshith Raj V/output2.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
column 1,column 2,column 3
"Major new features of the 3.12 series, compared to 3.11",And now for something completely different,<br/>
More resources,<br/>,Enjoy the new releases
<br/>,Enjoy the new releases,"<span style=""font-size: medium;"">Major new features of the 3.12 series, compared to 3.11</span>"
And now for something completely different,"Major new features of the 3.12 series, compared to 3.11","<span style=""font-size: medium;"">More resources</span>"
Enjoy the new releases,More resources,
"Major new features of the 3.12 series, compared to 3.11",<br/>,
More resources,And now for something completely different,
<br/>,,
12 changes: 12 additions & 0 deletions Vivekanada_session1_4VP20CS072_Rakshith Raj V/scrape.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
import requests
import csv
from bs4 import BeautifulSoup
res=requests.get("https://blog.python.org/")
soup = BeautifulSoup(res.content, "html.parser")
titles = soup.find_all("h1")
with open('output2.csv','w',newline='') as f:
writer = csv.writer(f)
writer.writerow(['column 1','column 2','column 3'])
for row in titles:
writer.writerow(row)
f.close()