Performance, Load & Stress Testing on Mobile Apps

First of all, it’s important to understand the key differences of these terms. It’s mostly used interchangeably and considered to be same, but actually it’s not as their goals are different.

Testing Type	Key Goals
Performance Testing	·         Establish a smooth, controlled, stable environment with a clear defined set of expectations (e.g. expected load, acceptable response time & throughput ..) & record repeatable measurements ·         Eliminate required bottlenecks, while increasing load & establish a baseline for various load levels
Load Testing	·         Is to be increase load constantly via automated tools to operate at predefined level & hence it’s part of the process of Performance testing [Incremental or Sequential] ·         Doesn’t aim to break the software, but keep the software working at the highest load possible on peak hours ·         Rectify bugs identified to ensure performance testing baseline is met
Stress Testing	·         To test the software under unpredictable scenarios like increasing load by thrice, sudden failure of DB connectivity etc and try to crash the software or see how software reacts under unexpected failures/scenarios.

Next questions that arises

1. How do we do it? What tools can help in performing this kind of testing?
2. How does performance/load/stress testing on mobile apps differ from web apps? What are the typical challenges faced at this time?                              

Starting with second Q first,

Whether it’s a mobile web or native mobile app, performing load/stress/performance testing on mobile app is similar in many ways to web app. However, testing scenarios / environment is bit different and becomes more challenging, when it comes to mobile app testing

Some of the key challenges are:

• Different types of OS (iOS, Android, Blackberry, Symbian etc) & version fragmentation
• Addressing to variety of device form factors – screen size, processor speed, multiple input modes
• Simulating bandwidth limitation of mobile network connections.
• Simulating under variety of network speeds like GPRS, EDGE, 3G, HSDPA etc
• Emulate mobile device traffic from different parts of the world
• Recording user actions performed on mobile apps
• Lack for mature test automation tools
• Load generation is bigger challenge for mobile app performance testing

There are some tools in the market that can help to some extent (as each of them have their own pros and cons OR things they can or cannot do)

• Recent annoucement by MicroFocus of launching SilkPerformer 9.0 (2012) - that supports Mobile Web & Native apps testing on iOS, Android & BB platforms
• HP LoadRunner – Best tool as of now -  that supports Mobile Web & Native apps testing on iOS, Android, BB & WM platforms
• Use NeoLoad that supports Mobile Web & Native Mobile Apps
• Use JMeter for Mobile Web App Testing (Simulators)
• IBM Rational Performance Tester (RPT) for Mobile Web App Testing

Hope to see some new tools coming soon and make life easy for Mobile QA testers! 

Sales Super Saturday (SSS) @ Sep 17, 2011

This time, we enjoyed our Sales Super Saturday at InfoStretch office.  

Agenda for Sales Super Saturday on Sep 17, 2011

10:15 AM : Morning Keynote
10:45 AM : The Magic Called Follow-Up
11:15 PM : Brand Failure
11:45 PM : Biography - Dhirubhai Ambani
12:15 PM : Telephone Etiquettes
12:45 PM : Lunch
3:00 PM : Enterprise Mobility
4:00 PM : Movie / Surprise

My viewpoints to this SSS:

It started with a welcome note, followed by a Europe Sales Strategy Plan shared by our Head - Business Strategy (ISPL Sales Sardar). Hearing at projected sales target for next year 2012-2013 raised our hairs. We all then applied the mantra of Ranchodas Chanchad (Aamir Khan in lead role @ 3 idiots) by saying "Aal Izz Well ... Aal Izz Well ..." 

It then entered into some great sessions as scheduled for the day. I personally liked the content and delivery of "The magic called follow-up" presented by one of our BD team member. The session revolved around the essence of follow-up in sales, classic success stories supporting this strategy & helping to build a long term biz relationship.

We also attempt to do something different @ SSS. This time, we have two new ingredients 1) Recording Luncheon Qs 2) Surprise Event.

Luncheon Qs were A) What's the most embarrassing moment till date? 2) What's your brand identity @ InfoStretch? Two Super Qs..... With equally hilarious and out-of-the-blue answers from each one.

Surprise Event - To decorate your workplace using your childhood photo & craft skills! Some, like me, just appreciated and motivated others with this task...

Instead of movie, we opted for playing cricket @ our parking basement. Everyone tried to show-off they are masters of this game in their own style. Swing bowling like Wasimbhai & Malinga, Spin (Phirki) like Bhajji & Monty Panesar, Batting like Mahi & Mr. Dependable.. Fielding... Ah who does that [not even our Indian cricket team :)].. Everybody looks at each other to get the ball.. 

6 PM and it's time to pack & go...

Yet another SSS ended with great learning and fun!

Will BlackBerry Messenger (BBM) continue to remain key differentiator for RIM?

BlackBerry Messenger (BBM) – the most desired feature from BlackBerry will now be challenged by Apple’s iMessage with the official release of Apple iOS 5. It is expected to get launched in the end of 2011. As mobile enthusiasts are waiting for this release, we hear about Samsung ChatON –  a cross platform mobile chat service to go live in next few weeks (prior to launch of iMessage). With this, Mobile Instant Messaging (MIM) competition is getting HOT and Interesting!!!

Let’s try to compare existing BBM with upcoming 2 MIMs that’s creating buzz & going to compete 1on1 soon.

It looks like Samsung ChatON will rule the IM Game, but, it’s too early a statement to make. Let’s see how the upcoming mobile IMs performs on what it claims to out-beat BBM & does mobile users accepts with both hands as they welcomed BBM for years now.

Google’s strategy for introducing Chrome OS

Can we think of “Operating System” that operates entirely in cloud? An operating system that doesn’t require installation on device nor has a desktop screen. All that you need is an internet browser with good internet connection to explore apps that runs over internet.  That’s what Google’s new web based OS does. They call it “Chrome OS”.  

Well, at first instance, you feel it’s WoW, but next you start thinking about below things, that go against of this new OS, such as

• It’s requires Internet EVERYTIME? No Internet... No Access to Apps... Emails… As I write there are no apps that work offline. Hopefully, in coming time, we might see apps that work in online/offline mode with data sync. 
• All work/data that you do is stored in Cloud…  Chrome OS need to provide some mechanism to access/manage files locally.  Additionally, privacy/data security is still a debatable topic in Cloud Computing
• This might promote SaaS based Apps, where SLA terms needs to be paid a great attention 
• Performing certain tasks like photo-editing, printing jobs, working with external peripherals etc could be bit difficult and requires some workarounds to handle.
• On performance, at any given day, it cannot compete with desktop based apps

So, just with above few points, we feel it’s not the OS to go with… We then start comparing with Mac, Windows, Linux/Unix etc and see further drawbacks down under.

Then, what Google is after, for whom it’s designed for, what’s the strategy behind?

Well, Google is aiming for users

• That spend most of their time over Internet
• That wants simple, easy to use interface with less or zero configuration, settings, updates
• That wants all data to be stored at one place
• That wants speed at work with low battery devices & minimal system requirements
• That wants almost zero maintenance cost, free from viruses/malware, hard drive crashes, data backups
• That wants apps (free/paid) to be downloaded from one market place (Chrome Web Store)  

In Short, it's an ideal OS for users that demands cheap, high end computing…  A perfect blend of Price and Performance

Google’s Chrome OS is already made available on devices manufactured by Samsung & Acer called “Chromebooks” that one can buy from Amazon or BestBuy.

It’s early to say how this new OS will change the dynamics of OS market & user preferences on using computing devices like desktops, laptops, chromebooks, mobiles or tablets. As Netbooks are on verge on dying, I believe this chromebooks will stay for more years. 

Google continues to surprise by launching this OS after the proven success of Android, the mobile OS, that’s creating buzz all around. 

Can citizens of India contribute to fight against terrorism, another vital issue that India is facing?

With Anna Hazare’s fight against Corruption and his firm determination to introduce Lokpal for goodness for citizens of India, we all are witness to one thing that “Lok Shakti” (meaning.. Power of the people) can mould or drive anything. Though, as I write there is no final conclusion on Lokpal with no major progress, but I believe – it’s a need and not a choice to have Lokpal NOW or NEVER.

Coming to “Lok Shakti”, can citizens of India help Govt in some way to fight against Terrorism? Let’s accept the fact – India being a democratic country, a fast developing country, still b/h world class infrastructure & Hi-Tech equipments, huge population, diversified language/religion/culture, low literary rate, cross-border issues, internal big issues/scams etc, it’s difficult for any ruling government to fight against unplanned terror strikes and counter fight strategically, keeping low count of human lives, security personnel, property damages etc.  More importantly, to have a better peace of mind for people living in India and foreign visitors that travel to India.

Of course, there are some ways and awareness programs implemented, whereby citizens of India can contribute. Adding to existing programs, can a mobile be used as a tool to help to prevent/forecast/resolve terrorism activities?  

I believe, YES, it can be. Below is a workflow diagram at broad level.

Key Challenges to implement this would be

• Making it Simple to use with ZERO training 
• Easy One time registration & validation process
• Tracking of User profiles carrying multiple SIMs/Phones
• Keeping user profile & captured data confidential
• Transforming different forms of data into usable format
• Relating/mapping captured data under which incident
• Defining rules of which data is important and which is not
• Seamless integration with current GoG intelligent systems
• Managing high volume of data, archiving   
• Data manipulation & forecasting
• Timely actions
• End-to-end secure environment
• Transparent, Encouraging loyalty/reward programs     

Will it be effective or make magical difference?

• “Jagrut Janta” + “Jagrut Sarkar” can make it effective
• Will certainly add value to our Intelligence
• Can turn to be a need and not a choice   
• Additionally, similar concept can be applied for traffic policing, road accidents, construction process etc for effective monitoring & forecasting.   

Please feel free to share your views on this and other ways to make India, a secure place to live and explore.

Jai Hind!