Computer Vision – Grand Dad of All IoT Sensors

manish blog

Human body is the most efficient and powerful system that exists and is a result of evolution over millions of years. And it would make complete sense to emulate its mechanism as we build modern systems.

IoT or “enchanted objects” as I like to call them are also moving the same direction. The 5 human senses that operate through the organs map to the nodes in an IoT system. Same is the case of actuators that map to the voice, gestures, movement and other actions that humans perform through respective actuation organs.

Spinal cord maps to the IoT gateway that forms the backbone of any IoT system and does not just serve the purpose of communication between the organs and the brain but also provides the reflex actions through a local intelligence that has been driven back from the brain by the models created through experiences and DNA

And of course the brain that maps clearly to the cloud platform in an IoT architecture. We can go on an on with this analogy, but that is not the focus of this blog.

Now that we have established that its the human body that we are trying to emulate, lets understand which is the most powerful sense of the human body. Vision. Right? If that is the case, wont it make complete sense[pun intended] to use the same sense effectively while building an IoT system? Lets park this thought for the time being while we evaluate the challenges with current sensors.

When it comes to IoT solutions, getting the right sensor with accurate reliability is the toughest part. That we have learnt through numerous challenges that we have faced with even simplest of use cases. Retrofitting the sensors or reading information from existing sensors [analog or digital] is the other challenge because bulk of use cases we come across require IoT enabling existing assets and systems.

Significant investments are required to update infrastructure, get the sensors installed, create complex networks and its a multi year job to get it all correct and operational. Then comes the challenge with the wear and tear of these sensors and they need to be continuously calibrated or maintained.

Vision has huge power and images / video is our answer to it. Only if we can tap into the information that it provides, we can create some really powerful IoT systems. We can “read” existing analog dials and digital meters. We can compare time series images, extract intelligence and draw inference from them. We can count based on movement of objects from and to a defined video frame. And the system can “learn” from all this behavior. This is what we all do right from a few days after birth.

Axelta provides state of art and innovative IoT solutions for different verticals and domains and we at Axelta have realized the power of “computer vision” in IoT and have done some really interesting experiments and R&D to harness its power. We have also developed hardware that enables this both at the edge level and at the cloud level. The deeper we are going the more we are getting convinced on its power to solve a huge number of digitization use cases. As of now, we are applying its power in security, retail, advertising and many more other areas. If you are interested to know more about it and would like to discuss your requirements with us, please contact us at solutions@axelta.com with your use case.

Manish Agarwal
Co Founder – Axelta Systems

IoT Business Models and Monetizing IoT Ideas

As per many predictions, IoT is a multi trillion dollar value creation opportunity. And everyone is trying to position themselves as a comprehensive end to end player in that space. This includes

  • Appliance manufacturers- Samsung, LG, Hitachi
  • Industrial automation players – Siemens, Honeywell, GE
  • Semiconductor manufacturers – Intel, ARM, STM, Mediatek
  • Large technology companies – Amazon, Google, IBM, Microsoft
  • IT service providers – Infosys, Accenture, HCL, TCS
  • Consultants -E&Y, KPMG
  • And many more

As we interact with and train many players, experts and stakeholders in this space, we have realized that while everyone is excited about the opportunity, many of them are still not clear about their game plan and are also not in a position to provide comprehensive reliable solutions and services.

The reasons are many including inherent complexity and uncertainty of solutions, having the right partner ecosystem, right talent as well as identifying the correct sweet spot based on your core competence, market you are operating in and the opportunities that exist

After having spent almost 3 years in this space and after implementing multiple successful and some not so successful solutions, we have realized that IoT is too big an animal to tame in a one go and a very focused and strategic approach is needed to get the right mix of value chain positioning, vertical selection and picking up the right technologies and architecture. Breaking down the problem into smaller pieces, managing the customer expectations so that they don’t consider IoT as a silver bullet that solves all their problems is also very critical.

The other tough challenge is to come up with the right value proposition and justifying the RoI of the investments. Especially because the initial investment will be towards getting the required network, infrastructure and business processes in place to bring IoT into current operational processes and technologies. Especially evident in shift from Industrial M2M systems to IIoT/Industry 4.0

A big mistake could be to try and eat the entire cake alone. There are too many components and too many technology, architecture and business process trade offs to be taken to rationally be able to get your hands around. The key is to rapidly go-to-market with minimal upfront investment. Leveraging existing commercially available systems effectively should be part of the core strategy.

Axelta is one of the few companies world wide that has built expertise across the value chain. Right from sensors, to wireless networks, to hardware platforms to cloud based platform and mobile apps. Our IoT enablement ecosystem – Osmosis, is time tested and can provide 80% of the pieces out of the box for solving your business use cases. We also have excellent experience of practical problems faced in the field after having deployed multiple solutions in the market to be your partners to develop and deploy solutions in a reliable, cost effective manner. Check out more about our ecosystem, case studies and more on our solutions site. Axelta has also done some path breaking work in computer vision and video analytics

Axelta also have the entire set of services from getting you started through our IoT bootcamps. Get deeper into technologies through IoT analytics program and other technology training, consulting services, engineering services and more. The chart below explains how we can partner together.

Below is a link for a webinar we had conducted where we covered many of the aspects I have listed above. Contact us at corporate@axelta.com in case you have any requirements that you want to partner with us for any training needs.

Connect with me at:

Manish Agarwal – manish@axelta.com, LinkedIn

Co-Founder – Axelta Systems

Drone Port Mesh Network (Delivery Logistics Solved)

Shawn is bewildered, forgot to buy gift for his daughter Eli’s birthday today and its already 7 p.m in the evening. He has recently shifted to the row houses on the outskirts of Hyderabad near to the bypass where he can skip almost the entire city and reach home in 70-80 mins. He was almost regretting the decision as there is no toy store nearby he can visit and does not have the energy to drive to the city. He goes online to a retail store. Recently his daughter has mentioned a particular toy which is a rage in her school and luckily he is able to recollect the name and buy it online with that new fancy delivery option.  It is already 7:20. He drives home praying and as he parks his car in the driveway he looks at his watch, its 8:45 p.m. As he steps out he could hear his daughter talking excitedly to his wife and explaining something. Suddenly the house door opens and Eli rushes out and hugs him. To his relief she has the toy in her hand, delivered 15 mins back. Wife is at the door with that look of “why can’t you plan better” or “you lucky bastard”, I can never tell exactly, but Eli is happy. Thank god this new tech option works and works so well. Delivery in a city with 60-70 km diameter with 11 million people with this accuracy.

Case 1:

We call the new technology “Drone Port Mesh Network”

The technology is a mix of Drones and Humans in a most time efficient manner and uses a least hop mechanism. So as soon as Shawn ordered the toy, the least time and highest probable route was selected and order processed.

Typical steps involved are:

  1. Shawn orders the toy on his mobile app with the retailer “ABC Corp”.
  2. Order reaches the nearest warehouse which has the Item (toy) available.
  3. Item goes to the nearest Drone port located at rooftop in every business district.
  4. Item flies from Drone port to the Drone port nearest to the delivery location.
  5. Item is then taken from the Drone and last mile is done by a delivery person physically.
Delivery using Drone Mesh network (40 km Delivery) for any item Manual delivery process
Ware house packing and labelling:  10 mins Ware house packing and labelling:  10 mins
Drone loading and configuring: 5 mins Loading into delivery Van: 5 mins
Drone travel to Destination port (distance 40 km)  20 mins Truck/Bike travel to Destination (distance 40 km)  60-120 mins
Unloading and loading onto delivery backpack: 10 mins
Delivered at destination: 15 mins Delivered at destination: 5 mins
Total Time taken:  60 mins Total Time taken:  80 mins – 140 mins

 

 

Case 1: Delivery process for any Item using Drones

drone 1

Case-2:

 

Let us take another use case of delivery of food from your favourite restaurant to your home 40 km away. As of today, no restaurant will take this order, but with this drone delivery, very much possible.

Shawn orders the meal online from his app. Does not care about where in the city, restaurant is located

 

 

Delivery using Drone Mesh network (40 km Delivery) Manual delivery (unviable for > 8 km)
Once order come in Delivery person from nearest Drone port/another location reaches the restaurant – 10 mins Person from the logistics company  reaches the restaurant – 10 mins
In Parallel Food is made ready and packed – 10 mins In Parallel Food is made ready and packed – 10 mins
Delivery person reaches the nearest drone port and loads the food – 8 mins Delivery person starts for the destination 40 km away – 60 to 120 mins
Drone travels to the Port nearest to the destination 40 km – 20 mins Delivery person delivers at the destination
Delivery person unloads the package and delivers to the destination –10 mins
Total Time – ~60 mins Total time – 80-140 mins

 

Net time taken to deliver food at a distance of 40 kms is ~50 – 60 mins.  It’s the predictability and human labour cost savings that make the delivery viable and possible.

 

drone 2

Drone authorization:

  1. Every Drone that takes off is authorised by Drone authority and approved.
  2. Every drone gets an IPv6 number on being built and is registered with Government authority.

 

Drone port functionality:

These are typically built on unused rooftops of commercial buildings. This is a new rental opportunity for landlords. This is how a typical Drone port will look like. It will have:

  1. Sufficient space for landing and take off
  2. Quick drone loading unloading infrastructure including basic drone maintenance
  3. Drone quick charging stations.
  4. Small storage for non-food items to deliver at leisure.

 

Possible Drone port Mesh Network in Hyderabad:

drone 3

 

Drone port visualisation:

drone 4

Cost analysis:

Using this method quick and reliable delivery will become an accepted fact. Cost of long range delivery using humans is cost prohibitive and time consuming. Using a person to deliver restaurant food over more than 6-7 km means that you have to add 25% of day salary of the employee to order charge. Drones will change all that. Thinks like medicines, urgent spare parts will also use this Drone facility.

Capex:

Building this Capex of Drone ports etc. will require significant investment. Existing logistics players/large corporates can do this. Technologically this is very much feasible as Drones only have to go point to point and not navigate through crowded streets.

 

Please get in touch with us at pyush Jain (pyush@axelta.com) for more details.

 

The Emergence Of A New IT Professional – IoT Full Stack Experts

There have been two distinct worlds in the computing world. Physical world represented by the Electronics [which includes hardware, RF, embedded and related technologies] and Virtual world represented by Software [which includes databases, web development, analytics, mobility and more].

These Physical and Virtual worlds have come together and are working in cohesive manner to enhance each other and enabling use cases never thought about before. This magical space is called IoT or Internet of Things[everything], ambient intelligence and much more.

In line with the two distinct technology spaces, professionals also were categorized in the same manner. You were either an electronics professional or a software professional. With either a deep hate or deep reverence [or both :)] for the other space.

With the changing technology landscape, when the physical and virtual worlds have come together, its high time that the chasm between the two types of geeks also gets bridged. And make no mistake, its a huge gap to be filled.

This leads to a new breed of technology professionals who are experts in one of the two fields but have a fair bit of knowledge of the other field.

  1. Electronics IoT expert [Embedded and Hardware] with full stack IoT knowledge
  2. Cloud IoT expert [UI, Webservices, Analytics] with full stack IoT knowledge

Add to that, if the expert has a good knowledge and experience of the domain they are operating in, they can really be those unicorns who can make the elusive success of IoT implementations possible. These professionals can emerge to become the IoT solution architects and future CIOs / CTOs of large product or service organizations.

At Axelta, we firmly believe that this is the future direction of the industry. We are already seeing a momentum building in this direction and have been contributing towards building such professionals – We call them IoT Scientists. 

A couple of our efforts in this direction are our end to end IoT bootcamp, that we can been running for almost 2 years and have trained more than 1000 professionals through the program. Many of our participants have leveraged this and are on their path to become IoT Full Stack Experts / Scientists. More about this program is available here.

We also conducted a webinar recently on this topic

We have also launched a program in the US where we are hiring  software or electronics professionals / students, taking them through a grueling 6 weeks course where they are trained on all these technologies and more

  • Electronics and Embedded Development including sensors, different microcontrollers, wireless communication
  • Communication Technologies like BLE, Z wave, ANT, HTTP, MQTT, CoAP
  • Cloud Technologies including Web services, UI, scripting, Cloud Computing, Relational databases, etc
  • Mobile Technologies
  • Analytics, Big Data, Machine Learning, Complex Event Processing
  • End to End IoT Solution and Real Life Use Cases

These IoT scientists will then be embedded in exciting IoT projects and product development efforts and can in future be those elusive and expensive IoT scientists who can be hugely successful in the demanding future technology space.

Internet of Things: Vision 2020

The promise of IoT is coming true.. today. Possibilities are expanding each day and on the ground traction is gathering force across domains. Challenges remain, but the wave is now unstoppable and has washed ashore already.

Having trained 1000+ professionals worldwide and being connected to more than 10K IoT enthusiasts, we have a very good pulse of ground ZERO as the technology happens. We recently conducted a webinar on how our future with ambient intelligence looks like and how embedded intelligence in our day to day THINGS will make them enchanted and magical.

From Things as a Service, to drone delivery, to wearable health care devices our world in 2020 and beyond will be much different from now. Technologies like invisible hardware, energy harvesting, machine learning and seamless communication will make the inanimate world around us alive like we ever imagined. Check out our webinar on the subject conducted for TechGig – our partner for creating largest IoT community in India and beyond.

Axelta is worlds largest and most coveted training and knowledge provider in the world. Our unique IoT training that embeds years of successful IoT product and solutions development learning is empowering IoT enthusiasts and companies get a huge jump start in their journey. Find out more about it and enroll IoT Bootcamps.

Beacon – The Path Breaking IoT Technology

Can you imagine how we lived when smart phones not existed? Isn’t it difficult? The world around us has been revolutionized by Technology & Innovations and it has completely changed our life and the way we do anything. The next and even bigger technological wave is Internet of Things which is more commonly called IoT.

The IoT Beacon is one of the path breaking technology standard that helps us locating a device/thing in a close proximity like inside a building. Saying that, now it’s possible to locate and find your watch /keys/wallet in your home if you forgot where you kept them. However, Beacon has much more broad and important use cases than this. It revolutionizing the retail industry with goods selling themselves and a better customer experiences. Use cases of Beacon ranges from Home Automation to Hospitals to Retail / Commercial Buildings and many more.

So, what make Beacons so useful?

Well, it’s the technology behind Beacon – which is BLE (Bluetooth Low Energy) and the Backend Cloud Integration system. Find in this webinar video how Beacons work,  their evolution, big players behind Beacon and future opportunities.

We cover this and much more in our hugely popular IoT Bootcamps that are conducted online. Find out more about them at our site

You can also join our web forum “IoT Interest Group” to stay updated on Internet of Things. Join Here.

Power Constraints, Challenges and Strategies For IoT Devices

One of the tough challenges that most of the Internet of Things solutions face is how to get extra bit of battery life for the innovative IoT solutions to start making practical sense to customers.

Wearable devices, security solutions and many remote location monitoring have this constraint that needs to be tackled effectively.

We at Axelta have been dealing with these challenges and have built a good understanding of the issues and possible approaches to get multi-year battery life. Some of the insights related to these challenges and possible solutions, we had shared in a recent webinar.

We get into more specifics related to building practical solutions that will work in production in our unique bootcamps that we conduct regularly. You can check it out on our Online Bootcamps page.

Career Opportunities in IoT

Internet of Things has opened up an amazing number of new use cases and innovation opportunities for businesses across domains and verticals.

We have been surveying this space and recently did a webinar on the subject where we shared our insights on professionals from different background can prepare and benefit by being early adopter in this space.

Interestingly, IoT has no new technology but its the combination of many that makes the magic happen. So, professionals and subject matter experts in their respective areas just need to understand the end to end piece to steer their career in the direction of IoT to make most of the opportunity.

Axelta is largest IoT trainer in the world and has built a unique program that we deliver online. We have trained more than 500 professionals world wide with 100 each at Intel and MindTree. You can get more information about this training here. Or you can check out our 5 mins Video that gives a very quick view of the training.

100 Smart Cities in India – Smart Utilities

In my previous post, we had discussed about a conceptual understanding of Smart City and its relevance from India context. Coincidentally, there was a a meet up organized by DevThon on the same subject this weekend. Though the participation was limited, I was excited to see that people are thinking beyond the hype of “technology” adoption to make cities smart and are actually talking about on the ground challenges and their solutions.

Given the fact that there is a serious gap between the basic necessities on electricity, hygiene and clean water in most of our cities, straight away going for a high technology solution for solving problems will not work. For example, it will not help to put thousands of sensors on the roads for capturing city information, if we are not sure how long those sensors will work and till the time, we have a robust ecosystem to maintain them and use the information from these sensors.

Its heartening to see that there is a group working on creating awareness on the different sources of information and city level grievance redressal agencies. Their approach to disseminate the information gathered through printed pamphlets is also taking into account that a large portion of the residents don’t have smart phones or access to internet.

Another interesting aspect that came out was that with such a high population density in a city like Hyderabad, a traditional approach of “smart city” will not work. Citizen participation and involvement in this exercise will be a key parameter. Building greater civic sense and a paradigm shift in how residents see their role in overall livability of the city and management will be the critical success factor for any initiative to be successful.

Though, this is not the theme of this blog, so lets get back to the next dimension of Smart Cities – Smart Utilities :)

There are two key areas of within utilities where there are significant challenges and scope to be made smarter for better results

Smart Grids

 

Screen Shot 2014-06-18 at 8.27.21 PM

India has one of the weakest electricity grids in the world. Being the 5th largest grid systems and having the dubious distinction of one of the highest distribution losses [24% average and in some states going up to 62%] the state utilities losses itself are 1.5% of the GDP.

Therefore there is a a huge opportunity of modernizing our grids and in the process making them smarter. There have been multiple initiatives in this direction for more than a decade and some states have made very good progress in that direction. What is needed is a multi year and multi pronged strategy that would involve not just modernization and using latest technologies but also improving the execution capabilities to drive such huge initiatives. This might also involve privatization of the utilities that are still under the control of states and driven more on political angle than efficiency and effectiveness.

Some of the key aspects of smart grids deployment and its relevance and initiatives in India are:

Priorities

Impact

Smart Grid Initiatives and Application

Meeting Demand Shortage
  • Augmentation of generation capacity; efficiency improvement
  • Power evacuation and grid access
  • Demand side management
  • Demand response
  • Peak load management
  • Crew management
Clean Energy Deployment
  • Require smarter systems for power balancing to deal with variability & unpredictability
  • Renewable energy integration
  • Demand response
Operational Efficiency Improvement
  • Need for ability to control and monitor power flow till customer level
  • Theft management
  • Asset monitoring
  • Meter data management
  • Substation automation
  • AMI
Enhancing Consumer Service Standards
  • Real time system to enable better system visibility and consumer participation
  • Power quality
  • Work force management
  • Outage management
  • Automatic Billing

Smart Water Management

 

Having access to clean and sufficient water is one of the major problems in a number of Indian cities. Lack of long term planning, distribution losses to the tune of 40% and above and red tape in state managed water utilities have lead to rapid depletion of ground water, which remains as a major mainstay of water supply in the cities. Lack of proper rain water harvesting and concretization of cities are further contributing to loss of this invaluable natural resource.

Smart Metering is an obvious and a proven solution that can bring in a significant discipline and accountability on water usage and management. Polluting and exploitation of existing water resources and water bodies is the other big challenge that the cities currently face and is having a large impact on the health of the residents. Innovative usage and deployment of Internet of Things for better monitoring and control for water and waste water management can provide significant help in meeting these objectives. Organizations like Aquamatix have done some very good research in this area and come up with end to end solutions that provide a holistic solution for smart water management.

There are many such application of Internet of Things in the utilities space that can be explored make Utilities and cities smarter. Signing off now, more about other Smart City dimensions like the following in my next blogs in the series.

  • Smart Buildings and Homes
  • Smart Transport
  • Smart Traffic Management
  • Smart Health
  • Smart Waste and Ecology Management

Axelta as an organization has been focusing on evangelizing adoption of Internet of Things in India and is working on a number of projects, community initiatives and competence development in collaboration with private and government educational institutions to help make the vision of 100 smart cities in India possible. Our IoT Academy that does a 2 days boot camp to equip social and technology entrepreneurs to understand and incubate ideas is also a step in the same direction.

 

100 Smart Cities in India

Smart City

We’ve recently heard our new PM, Mr Modi talk about 100 smart cities to be created in India and just recently CM for AP, Mr Naidu declaring that he would like to make 10 cities in AP as smart cities. We also heard that IT minister of Telangana would like to have free Wifi across Hyderabad.

Sharing my understanding of a smart city its impact to the denizens of any Indian city:

A smart city, at a philosophical level would mean an urban center that has been optimized and is self sustaining on these fronts

  • Human resources

  • Socio economic implications, welfare and inclusive development

  • Cultural

  • Financial capital and infrastructure

  • Natural resources and environment

 

To summarize, “Livability” of an urban center that is sustainable over a long period is what defines a true “Smart City”

There are many “policy” level implications to make it all possible though eGovernance and Internet of Things plays a very important role in making a city smart. World wide there have been a number of initiatives and organizations like IBM and CISCO are doing good research and a number of pilots in this area. Intel had recently started an initiative to make Dublin as first Internet of Things city.

Here, I have evaluated some of the critical applications of IoT from Indian city context.

Public Safety

This is one area where IoT and application of ICT [Information and Communication Technologies] can have maximum positive impact.

  • CCTVs at vulnerable and high density areas is something that a lot of Indian cities have now started implementing. Though, their effectiveness and upkeep is something that has a huge scope of improvement. Also, ability to monitor and analyze all the video data generated from these devices is a big question. This is where the latest development on big data analytics, motion analysis, facial recognition, etc can come have a positive impact.
  • There is a large amount of ground information that gets generated at individual police stations. This information if captured in a systematic manner, mined and processed along with police database on “bad” elements in a city, in a holistic manner can help in generating “predictive” analytics that can help predict and prevent a number of crimes. In the US, cities like Chicago and New York have been able to reduce crime rates by more than 30% through this. I understand that there a number of other things that need to be in place within the ecosystem to enable it. Though, if we have such a vision, this can also be an opportunity. As the information systems in these areas would and are going to get build from ground up.
  • Citizens of a city play a critical role on the safety standards that prevail in that city. We already see a vast contrast in different cities and states. Besides the governments in these cities and states, the residents awareness and willingness to participate in the governance and their own safety also plays an important part. Smart Buildings, GPS enabled Vehicles, Personal GPS trackers and many such IoT applications working in and integrated manner with a Smart City systems will help complete the circle. There is a good traction happening in this space in some Indian cities and shall pick up pace.

More about other aspects of Smart Cities in Indian context in my next blog posts:

  • Utilities like Energy and Water
  • Waste management
  • Traffic management and
  • Transportation
  • Health

Axelta as an organization has been focusing on evangelizing adoption of Internet of Things in India and is working on a number of projects, community initiatives and competence development in collaboration with private and government educational institutions to help make the vision of 100 smart cities in India possible. Our IoT Academy that does a 2 days boot camp to equip social and technology entrepreneurs to understand and incubate ideas is also a step in the same direction.