Over_Intention3342

I will start from the end: Yes, the term AI is slapped on everything a bit too easily. But I think about it in the same way think about electricity. Years ago it was only about lighting a bulb, now it's semiconductors. So, despite both being 'electricity' one is more advanced than the other. It's similar to AI now, we are just at lighting a bulb stage. A tree in Primeclue can be thought of as a complicated equation, so it's hard for me to compare it to existing ML approaches. It can handle large datasets, it does not have gradient descend but it "learns" from existing "trees" and uses their parts to find a better solution.

It doesn't use activation functions nor gradient descent.

Yes, that would be much more productive.

The test set is only used for final evaluation. To get better grasp at what is happening see the code at https://github.com/lukaszwojtow/primeclue/blob/dev/backend/primeclue-api/examples/test_training.rs and check where test_data is used.

If you have to ask I would say python. Simple, has TensorFlow and others.