The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here
Scaling Execution Engine : RapidMiner 8
vipul_kumar
Member Posts: 20 
Contributor I
Hello,
I recently updated to RapidMiner Server 8 and I am exposing a lot of my models as API/webservices.
RM Server 8 sends the webservice requests to the Execution Engine which is one for each RM server instance.
How to scale this execution engine.
I have a small license with 16 GB RAM. What is the ideal QPS (Query per second) , the execution engine can handle?
Is execution engine capable of handling requests in parallel.
Tagged:
1
Answers
Vipul,
Web services are still (as of RM 8.1) executed in the main server container and are not distributed through Job Agents. The Job Agent architecture currently incurs a process startup time that exceeds the normal latency constraints for most web services so we maintained an execution engine in the server core.
The Web Service engine will run multiple calls in parallel and in testing on a small server environment I was able to achieve several hundred WS calls per second which included grabbing a simple model from the repository, passing in a row of data, scoring that data, and returning the results (was hitting around 40ms per call in my environment). On optimized infrastructure you could probably exceed this easily. You could also put several RM Servers behind a load balancer if you needed to up the throughput.