The widespread availability of cell phones has enabled non-profits to deliver critical health information to their beneficiaries in a timely manner. This project assists non-profits that employ automated messaging programs to deliver timely preventive care information to beneficiaries (new and expecting mothers) during pregnancy and after delivery. Unfortunately, a key challenge in such information delivery programs is that a significant fraction of beneficiaries drop out of the program. Yet, non-profits often have limited health-worker resources (time) to place crucial service calls for live interaction with beneficiaries to prevent such engagement drops. To assist non-profits in optimizing this limited resource, we developed a Restless Multi-Armed Bandits (RMABs) system. The RMAB system was evaluated in collaboration with an NGO via a real-world service quality improvement study and showed a 30% reduction in engagement drops. This model was eventually deployed by the NGO and has served over 350K women so far. These encouraging results have led to a new collaboration with the Kilkari program, the largest maternal mHealth program in the world. And we hope to see similar improvements in engagement with the use of our AI model.