While working on a offshore project, I found myself in a situation where there were several software applications running and although they were connected via socket based communications, the processes were generally independent of each other.
Whenever something went wrong it was a bit of a pain to try and figure out the order of events that led up to the problem by trailing through each of the processes debug log files.
After a little bit of investigation I realised that the process could be made easier if I could merge all of the log files together, allowing me to piece together all the debug log files where the entries are indexed by time and each log file being analysed is color co-ordinated.
During my investigation I noted that some of the log files were quite large (> 1GB) and I also realised that the time formats were different between the log files.
Although I would say that I am a novice when it comes to scripting in Python, I have been able to produce the Log Lacer application.
- Operations & Support
- Project Management
- Requirements Gathering and Analysis
- System Administration
- System Integration
- Project / Team Leader
- Dev Ops