Grafana is a multi-platform open source solution for running data analytics, pulling up metrics that make sense of the massive amount of data, and monitoring apps through customization dashboards. Ubuntu is a free and open-source Linux distribution based on Debian. Ubuntu is officially released in … Continue reading Setup Grafana lab on Ubuntu with Vagrant and Virtualbox
Are you tired of creating manual Pivot Tables?
Here is the technique which you can adapt to automate the monotonous stuff you do using powerful python!!
phpoffice/phpspreadsheet is a successor of phpExcel. We recently developed an automated solution to pull all the backup success rate reports from Dell EMC Data Protection Advisor (DPA). The portal which displays the report was good but not enough to use that information further like sharing the reports, pivoting etc..
After trying several methods, found this library to be very useful. There aren’t many examples available on the internet to retrieve data from MySQL and write to XLSX file. Hope this blog might be helpful who would like to use this library for creating XLSX files. Fear not, it doesn’t throw errors while opening this file in MS Office Excel(more…)
I had an opportunity to attend Python Basics Training imparted by Mr. Ashish Gulati. Ashish, a technology coach; was really good in explaining basics of language, data types and Pro & Cons of this language. The way he imparted knowledge was an unique experience. He was flexible to explain some of the real time use cases in data analytics, JSON, SSH connectivity etc.. and explained in detail about the various module’s functionality.
Thank much Ashish for the session, it was informative, very simple topics but effective learning experience, hands on coding was a big plus point. I have learned much that will assist me in my workplace. As an outcome, I have already started migrating from Perl to Python. This blog is about my first attempt to write Python scripts @ work.
Scripts written in Python would run from several VMAX3 Enterprise Storage Management Servers located at various data centers.
In continuation to my previous blog on charting epoch time series MySQL data using PHP. I started exploring generating better reports from the DB.
Inspired by the EMC SRM (M&R) storage capacity reports in PDF format, I thought of doing similar kind of reports “in-house” which should be simple yet standard to be shared with customers. I would like to thank Sapan Kumar from EMC who thought me so many things about EMC’s SRM (M&R) custom reporting features.
We have the data in MySQL DB and wanted to use the PDF module in PHP to generate reports. But which module is suitable and easy to use?
Please find sample reports screenshot produced below for reference. You could see the capacity reports of VNX and VMAX storage arrays.
If interested, please reach out to me to get the PHP code. Thanks for stopping by… Please leave your comments / suggestions.
I was writing PHP code to generate EMC VMAX performance reports / charts stored in MySQL DB. As we know that Unisphere REST API output performance metrics in epoch (13 digits) format (milliseconds). As an example, to draw a line chart for Frontend Director’s Read Response Time with X axis / Abscissa as epoch time. I’ve used below query to generate the datapoints to draw the chart using pChart
SELECT TIME(FROM_UNIXTIME(timstamp/1000)) as TIME, ROUND(AVG(perfval),2) as wrt FROM vmax_perf
where DAYOFMONTH(FROM_UNIXTIME(timstamp/1000)) = DAYOFMONTH(DATE_SUB(curdate(), INTERVAL 1 DAY))
and objname =’fe’ and perfparam =’ReadResponseTime’
group by HOUR(FROM_UNIXTIME(timstamp/1000))
Let me explain the above statement
TIME(FROM_UNIXTIME(timstamp/1000)) :: Extract Time from the epoch (13 digit) format in millisecond
ROUND(AVG(perfval),2) :: Average of Read Response Time per Hour rounded output to 2 digits after decimal point
DAYOFMONTH(FROM_UNIXTIME(timstamp/1000)) = DAYOFMONTH(DATE_SUB(curdate(), INTERVAL 1 DAY)) :: Extract day (ex. ’12’ from 12th Nov 2016 where current date is 13th Nov 2016) and display the data points
group by HOUR(FROM_UNIXTIME(timstamp/1000)) :: Print the datapoints for every hour
If interested, please reach out to me to get the PHP code.
Stay Tuned for more updates on MySQL queries to generate charts for Daily, Weekly, Monthly and Quarterly performance reports / charts. Thanks for stopping by… Please leave your comments / suggestions.
Thanks for stopping by… Please leave your comments / suggestions.