Project Data STEDI has three JSON data sources to use from the Step Trainer.
customer step_trainer accelerometer
This is the data from fulfillment and the STEDI website.
AWS S3 Bucket URI - s3://cd0030bucket/customers/ contains the following fields:
serialnumber sharewithpublicasofdate birthday registrationdate sharewithresearchasofdate customername email lastupdatedate phone sharewithfriendsasofdate
This is the data from the motion sensor. AWS S3 Bucket URI - s3://cd0030bucket/step_trainer/ contains the following fields:
sensorReadingTime serialNumber distanceFromObject
This is the data from the mobile app. AWS S3 Bucket URI - s3://cd0030bucket/accelerometer/ contains the following fields:
timeStamp user x y z
Using AWS Glue, AWS S3, Python, and Spark, create or generate Python scripts to build a lakehouse solution in AWS that satisfies these requirements from the STEDI data scientists.
Refer to the flowchart below to better understand the workflow.
