With some minor editing I converted the notebooks for the Quantra course on Reinforcement Learning in Trading to ordinary Python files and got it up and running in my new Docker container. And running. And running. Several hours later the screen seemed to have completely frozen, neither mouse nor keyboard had any effect, and I shut down the computer.
There was some output while it was running – time for each step. At the start it was 10 – 20 msecs per step, but by the time I shut it down it was 10 – 20 secs. I have no idea how far it actually got in processing the data, of which there was quite a bit more than my previous exercises in ML have included. I think I’ll have to include some sort of logging so I can get a bit more feedback on what’s actually happening. Or perhaps I should just use a fraction of the data. Or something. It would be nice to actually get some results. But at least the program didn’t crash, at least not after I fixed the issues that caused the first few crashes!