I have no coding skills, but figure I need to develop some to achieve the types of things I want to do. At the same time, I’m overwhelmed by the range of advice and tutorials out there. My current interest is research automation (especially report writing), so I want the fastest pathway to being productive.
As an example, let’s say that I need to publish a monthly report on key developments and policies in Canadian housing markets. To do this, I’d monitor a bunch of websites, copy/paste articles that I find relevant to a Word document (either organize them under city sections, or have a separate file for each city). The word file (s) might run to 200 pages, with lots of overlapping news across different articles. Some news of little importance might also end up in the file.
My report needs to be 5-10 pages summarizing the key policies and market developments under a city-by-city outline. I guess I could feed this into ChatGPT, but I haven’t had good results with large files. I’ve read about Langchain, which it seems I’d need a Python foundation to use. I also tried out quivr.app (langchain based) - uploaded 5 documents and asked it to draft a report, but it seemed to draw heavily from one document without being comprehensive/systematic.
Longer-term, I’d like to automate the information collection process, which I guess will require some scraping setup.
Any advice on approaching this, what to study, resources, etc.? Are there solutions to this already out there? Longer-term, can this type of thing be done easily on Windows with co-pilot? Thank you.