{"id":682,"date":"2021-08-23T12:35:20","date_gmt":"2021-08-23T12:35:20","guid":{"rendered":"https:\/\/metrics.blogg.gu.se\/?p=682"},"modified":"2021-08-23T12:35:20","modified_gmt":"2021-08-23T12:35:20","slug":"automl-lets-talk-about-it","status":"publish","type":"post","link":"https:\/\/metrics.blogg.gu.se\/?p=682","title":{"rendered":"autoML – let’s talk about it…"},"content":{"rendered":"\n
\"\"
Image from Pixabay<\/figcaption><\/figure>\n\n\n\n

AutoML, a promise of green pastures, less work, optimal results. So, it is like that? In this post I share my view on this and experience from running the first test using that model. <\/p>\n\n\n\n

First of all, let’s be honest, there is not such thing as a free lunch. In case of autoML (auto-sklearn), the price tag comes first with the effort, skills and time to install it and make it work. The second is the performance…. It’s painfully slow compared to your own models, simply because it tests a lot of models here and there. It also take a lot of time to download and to make it work. <\/p>\n\n\n\n

But, first thing first, let me tell you where I start. So, I used the data from the MicroHRV project ( 3. MicroHRV: Recognizing Rare Events in Microwave Radio Links and Intensive Care Units using Machine Learning \u2013 Software Center (software-center.se)<\/a>). The data is from patients being operated to remove clots of blood from the brain (although dangerous it may sound, the actual procedure is planned and calm). I wanted to check whether autoML can do better compared to what we have at the moment. <\/p>\n\n\n\n

What we have at the moment (for that particular dataset) is: Accuracy: 0.98, Precision: 0.98, Recall: 0.98 – using Random Forest classifier. So, this is actually already very good. For the medical domain, that’s actually in class of its own, given our previous studies ended up with ca. 0.7 in accuracy at best. <\/p>\n\n\n\n

When it comes to installing autoML – if you like stackoverflow, downgrading, upgrading, compiling, etc. and run Windows 10, then it’s your heaven. If you run Linux – no problems. Otherwise – stick to manual analyses:) <\/p>\n\n\n\n

After two days (and nights) of trying, the best configuration was:<\/p>\n\n\n\n