I am working on a data viz project. The first step is data collection. After several tries, I formatted the data into a shape that was easier for me to manipulate in JS.
I had to go through several iterations to get the data to the point where it was easier to work with. But I was just guess-timating what to do until closer to the end when I started seeing the logic of what kind of data structure would be most beneficial.
So my question is: is this going into the realm of data engineering? (Albeit at a very low level?) And, since I am NOT a data engineer, what are the rules of thumb, best practices, etc that I need to know to be able to do this type of simple data formatting (BEFORE loading into JS file)? What resources should I read…?