A recent customer was overwhelmed the number of production issues and asked me to review 3 nightly transformations that consistently delayed the company reports each morning. The three transformations consumed system resources and required 20, 20, and 30 minutes each (70 minutes in total) to complete.
So I reviewed the logs in the production environment, analyzed the custom transformation logic (start, object, and end-routines), and optimized the existing solution to deliver the same information but at a fraction of the prior run-times, allowing a nice margin for the team’s service level agreement with their business divisions.
I had decreased the total run-time from 70.0 minutes to 3.5 minutes (60, 60, and 90 seconds each) and she was ecstatic. A 95% increase in performance was an easy win, especially for busy people.
Fixing Data Load Problems Without Lifting a Finger
In the past, I had offered this service as part of a long project engagement. This usually occurred during lulls between the completion of one solution and the start of a new project. Now, I would like to extend this service as a stand-alone solution for new and existing clients to quickly reduce a major, but common headache.
If you would like to eliminate on-going issues with your nightly data load process, contact me to learn how I can help speed up your systems.
I believe there’s an incredible story hidden in every team. The way I share the lessons in these stories is through conversation and data. I just happen to build the analytics that asks the next question.