What is Data Engineering Intern all about ?
Posted: Sat Mar 09, 2024 7:48 pm
What is Data Engineering Intern all about ?
We are working towards achieving the Data extract from
1. offline data - could be structured or non-structured or semi-structured from data collected website like data.gov, kaggle etc.
2. we will also look to get from public API such as : postman public APIs to get data such as weather etc
3. we will also use
a. nextdoor
b. facebook
c. linkedin.
d. twitter
e.glassdoor
f. indeed and certain places and get live RSS feed .
then we have plans to do data stages such as silver, bronze and gold data.
Insert the final data into a NO SQL Database such as Big query or mongdb.
use visualization like Grafana or Looker etc to so the visualization chart.
Team : Nissanth and Aswath.
Started Date : 1st Jan 2024.
ETA : 30th June 2024
it may get extended further if we are not able to do finish.
Technologies : Python, GCP, Azure