Author | Easiest way to 'scrape' a transfer log |
Hi I am looking to scrape all the data from my transfer log to do some excel analysis.
Does anybody know a good way to do this?
My coding proficiency is quite weak and i've tried a few scraper extensions (chrome, windows) but they won't select the elements correctly.
I've done this before for limited elements with simple copy and pasting but I don't want to do this for hundreds of pages.
I'm looking to create my own way to export transactions, ideally with the filters on the log. |
Interesting! Keep us updated once it's working, it would be great to see some analysis. Unfortunately, I can't help, as I'm not sure how to -) |
best option would be to have it implemented as a service on Daily.
otherwise refer to the General rules
2.2. Any actions leading to traffic increase or considerable server overload are forbidden. In particular, automatic and semi-automatic scripts referring to the database or running game mechanisms are forbidden. Before using such applications, it is recommended to contact the Administration through the Secretary and receive a special allowance.
https://www.lordswm.com/about-game-general-rules |
Any comp sci wizards know about this? |
@Prozyk |
Write a tamper monkey script which just gets the transfer log page X and records all lines. The game returns entire html page in the request so just do the get element by id or class etc and separate each lines.
Add a delay so you don't spam the game with hundreds of requests at once. |