Software Engineer Intern
Based in New York, NY
Duration
May 2024 – Aug 2024
Responsibilities & Achievements
- Developed and deployed a Flink Application that would identify and auto-terminate degraded Hadoop nodes
- Reduced node identification and termination from 45 to 0 minutes, a 100% improvement in response time
- Decreased the number of pages for potentially bad nodes from 30 pages/month to 9 pages/month, a 70% reduction
- Created an efficient and scalable heuristic algorithm to identify bad nodes with a 90% success rate