I suggest you join the competition for training models for price prediction for the HFT case. More details here, referral here.

Any advice for an AI Agent contest ?

I stared a course on Data Analysis for the past few days . I have learnt a lot and I am still learn. In the next few days I will be giving the break down of what I have learn so far.

Today in Data Analysis class

Joining Data in a single Table
Data structures that requires the joining of data always provide for how it will be done . For instance in excel it is called *Vlookup* while in data base it is called *queries*

In Queries there are different types of joins which are inner joins, left and right outer joint and cross joins. The type of join will determine the end result, so it important to understand them. 

My Day Analysis class today:

On the practical aspect of joining data

When you join data you are using the field of data that is the same in both tables and it the same data type . Sometimes they will named the same and sometimes they will be not.An example was given of a data field of product ID and Sales ID ; linking this together may give no results or limited results because sales ID and Product ID should not be linked .

Journey to school
No school aka NZ , Volcano Erupting .
Naughty jueves
Un VEsting

Data Cleaning

Data cleaning is the process of standardizing the data and making it meaningful. 

Data cleaning might mean removing unnecessary columns, changing particular words to upper case , removing space , removing a particular address or adding , removing duplicated words or columns or row, and removing invalid rows. 

You must always have one key goal in mind when dealing with data : that the data is high quality.