DAT7015 Given a dataset/s, the students are required to analyze data to get insights into the dataset: Big Data Technologies Assignment, UOB, UK

Assessment-2 Brief

This assignment is divided into two sections

Given a dataset/s, the students are required to analyse data to get insights into the dataset. The students should clearly mention the research questions as well as the steps undertaken from importing data, cleaning, preparing data, and analysing data. The students should provide appropriate visualisation/s and report the results of analysis. All the steps/Python code/results must be shared.

(A) Data Analysis (75%)

•    On given datasets, draft appropriate research questions that you can answer through data analysis.

•    Given datasets, use SQL queries to create a merge/new dataset for analysis.

•    Perform data cleaning and pre-processing tasks on the new dataset.

•    Use HIVE, MapReduce, Spark, and machine learning techniques to analyse data and answer the relevant research questions.

•    Perform visualization using Python and PowerBI/Tableau and report the results. (B) Issues and Solution (25%)

•    Identify the current issues in the use of Big Data Analytics in crime analysis. Based on the identified issues, propose an effective solution using various big data technologies.