ToT Intro Olay Solgaard Bio ‘Olay Solgaard earned is PRD. degoee Som Stanford University in 1992. His doctoral dissertation: “Integrated Semiconductor Light Modulator for Fiber-optic and Display Applications" was the basis, forthe establishment of Silicon Valley fim Silicon Light Machines (SLM) 2 founded by De Solgaard in 1994, From 199210 1995 he eau out esses on optical MEMS as a Posdoctorsl Fellow atthe University of Califrna, Berkeley, and in 1995 he joined the Electrical Enginzesing faculty of the Univesity of Calfomia, Davia His work at UC Davis led to the invention of the mul wavelength Siber optical switch, which has ben developed into commercial prodicte by several companies. In 1999 he joined Stanford Univarsty where he is now a Professor of Elactical ‘Enginooring and the Director of Graduate Studies in the Department of Electricl Ensineeing Profesor Solguand's research interest neue optical MEMS, Photonic Crystal, optical sensors, microendoseopy omic fore microscopy, and solar energy conversion. He has uthored more than 350 technieal publications and olds 70 patents. Professor Solgsard sa Fellow ofthe IEEE, the Optical Society of Americ, the Royal Norwegian Socisty of Sciences and Leters, and the [Norwegian Academy of Technological Sciences, Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDToT Overview + What are the disciplines of IoT? + Cool applications and fantastic opportunities — Ada Poon + Sensors — Beth Pruitt + Small, inexpensive and very, very good + Circuits — Boris Murmann * This is where it started + Embedded systems — Phil Levis + Sensors, circuits and communication links playing together + Networks ~ Ayfer Ozgiir-Aydin + How does the internet support loT? + Big data and machine learning + Other certificates focus on these aspects of IoT Ideal IoT + Ubiquitous Why is it important? + Smart + Fourth industrial + Agile * Ondemand revolution + ToT will touch everything : Blend into background + Secure * Everything will have JoT + Low maintenance + Fast + Upgradable + Growing + Adaptable Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDToT will be the “next big thing” 10" 104 ‘re Tens of 5 Tons Billion 3 : as 5 ‘ita 3 Micon og 8 anime 1SBiions OF 1 Rios 1960 19701960 190020002070 2020 _ 2030 ET 9 i Seen ey Sensors Internet Security err Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDToT Overview + What will you leam in the short course? + These are the questions we will help you answer + What is your perspective on JoT? + How does the disciplines of IoT overlap with your expertise and interests? + Where are the holes in your knowledge that you want to fill? + What IoT opportunities do you want to pursue? * And ultimately + How to get the most out of your IoT certificate Cool Applications — Professor Ada Poon * Sustain (Smart cities) + Move (Self driving cars) + Heal (Healthcare) + Feed (Agriculture) + Make (Manufacturing and packaging) + The purpose of this section is two fold: * Get you excited about IoT potential + And more importantly, have you thinking of better ideas than the ones already out there Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDSmart Waste Management eyes! pcos com anaes inp Go from collecting 840 containers 4 times a day to collecting 80 containers a day. Increase waste collection efficiency by 90%. Smart Street Lights Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDSmart Street Parking + Infiared- and magnetic-based vehicle detection sensor mounted on the road surface + Zigbee, LoRaWAN wireless connections + Mesh networks are implemented with.” in street lights + Apps to direct drivers to empty spaces Dynamic parking prices Connected Vehicles — Combine private and collective transportation: The best of both 1 Yeu are comected to everyting you ned Ses OT wl OW 4 om + > 5 See rN oo onetime Seaacscececs” = SA Sad (on trafic Flows through the system ap government 2020 dpe com end const eile Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDMood Enhancing ~ Sleep Monitoring i Enhance Adherence — Ingestible Sensors * a 3 | npr rote com! np stron com brine sce Di you ake your plage emarecan- 1129689 sl Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDChallenges security may prevent heal + False positives + Alack of Electronic Health Record (EHR) integration and concerns about data + The need to adopt an integration-first mindset instead of keep building interesting/fun gadgets. Sometimes, a dumb gadget can be as useful if it could integrate seamlessly with the EHR. * Doctor's offices will be filled with perfectly healthy, but anxious patients Itheare from fully adopting the IoT technology. Precision Agriculture % oo eae 1 ay - ze ie . “ . meso see oe oni acer nal apie luis Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDFood Safety & Storage Efficiency + Wifi or cellular connectivity + When a produce recall is initiated, the juice machine will check the packs and A a prevent the machine from \ LL pressing affected packs —_ et Smart Manufacturing pellet nde 2015 hinge wack tema hme Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDScaling of sensors + Many sensors can be modeled as simple mechanical harmonic oscillators + The figure shows an accelerometer + The proof mass (m1) is accelerated and displaced + The displacement (Az) of m is measured + The acceleration is calculated as a=k-Ac/m (The spring constant, k, is known) + The highest frequency that this accelerometer 1 fe can measure is f = > Reference frame o Accelerometer modeled as mechanical harmonic oscillator Capacitive measurement of displacement + Most IoT sensors measure changes in electrical properties: + Resistance, capacitance, inductance + Our accelerometer is completed by capacitive measurement of displacement + Capacitors are great at measuring shorty, @ distance with very good absolute accuracy + Measurements of large displacements are better done by inductors (magnetic fields) Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDBlock diagram of MEMS accelerometer Noise and disturbances enter the system both as an equivalent acceleration noise, and as an equivalent signal noise in the position sensor Disturbances ‘and Noise ‘Acceleration S sensors: Small is beautiful ky (on- faz pet m 2 + Design objective: Measure the smallest possible a up to a given f + Looking at the first part of the equation, we might think that we should use a low & and large 1 - => lows — Given a constant £, only the ratio &/-f is important ~ A miniaturized accelerometer must have a small proof mass and a weak spring, but it is the ratio of the two that is important! — To measure small accelerations up to a given f, we therefore have to measure A: very accurately — For application specific minimum detectable acceleration and bandwidth, there is a minimum detectable displacement that our position sensor must be able to measure + Small structures have position sensitivity and ean be designed to have any resonance frequency MEMS sensors! k m a Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDElectrical components used in miniaturized sensors fee a Sn VY 4 irr [ea [Pa tie You 2 [pene Ot) Fam (5) | Gia) () (ee lnpeinee 2 Zepee Pores pp ae ° Enewy 0 pice ie Generic block diagram ~ Wireless, Accelerators & transceiver | | Microcontroller Sensors Mixed-signal imferiaces Actuators OH 2, || seo = 11.4 pA Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDKey: Duty-cycling # ToT transceivers are “mostly” off + Example: Receive/transmit within 1 ms, then go to sleep for 1 see Power/energy cost of wireless transmission Bluetooth : oa rad San . . aa Ant-sized radio Power 35.7 210 0.147 0.675 (mW) Bits/see 960 272 192 40M Energy/bit 153 2480 186,000 5.25 @) 7 = Numbers are a strong funetion of reach = Energy per bit tends to be lower for high-data rate links > Invested power amortizes better Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDKey issue for sensors: 1/f noise Toner logf = Analog MOS circuits come with a variety of low frequency artifacts that can easily "swamp out” DC or low-frequency signals of interest What is an embedded system? “An embedded system is a computerized system that is purpose-built for its application.” Elicia White Making Embedded Systems, O”Reilly This has deep implications for how they are designed and why. ‘Typically, want to minimize cost'maximize lifetime for a given expected workload. Optimized, custom software that uses as few resources as possible. Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDTwo basic cost considerations dominate Energy * Embedded systems have an expected workload — want to minimize energy required to handle the workload (longer battery life, more efficient) * More powerful, highly featured MCUs draw more power: can be more power efficient, but consume more energy for a given workload Money * Many embedded systems markets have tight margins (cars, appliances, ete.) * More powerful, highly featured MCUs cost more Both costs push designs to pick minimal MCU and optimize code for it ToT: MGC Architecture eMbedded Gateways Cloud devices Glowpan a Ziel ZWove Bluetooth, ‘CPAP Wii WirelessHART Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDTwo Game-Changers ARM Cortex M series + First released 2004 "s = Ultra-low power 32-bit processor Cc ety: * 8-96kB of RAM, 64-512KB code flash cortex = Sleep currents recently dropped <1. Uncles Frocensors by ARM Bluetooth Low Energy = First released in 2006 = Send a 30 byte packet once per second, last for a year on a coin cell battery + Support was weak until Apple incorporated into SS iBeacon, now all major smartphones include it iBeacon Historical Perspective on Wireless Systems 10° 18 10° 10%? nodes 1900) 19208 “ present tuture Se Dla i se Station to station Station to people People to people Everything to everything Paradigm shift in principles, technology, systems and applications. Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDTomorrow's loT Networks: © Massive number of devices, only few active at a time. © Bursty traffic, few bits to transmit © Complexity and energy constrained © Node identity may not be relevant. Eater Peed ono Rene Internet Security err Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDToT Overview + What will you leam in the short course? These are the questions we will help you answer: + What is your perspective on JoT? How does the disciplines of IoT overlap with your expertise and interests? Where are the holes in your knowledge that you want to fill? + What IoT opportunities do you want to pursue? * And ultimately + How to get the most out of your IoT certificate Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDCool Applications Professor Ada Poon Outline * Smart cities + Healthcare * Agriculture + Manufacturing and logistics Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDSmart Waste Management bp ecb com Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDSmart Waste Management + Ultasonic fill-level sensor + Cellular oT = + Solar powered eS) + Predictive pattetf recognition” . np lca com tera te mazagonect Smart Waste Management + Go from collecting 840 containers 4 times a day to collecting 80 containers a day. + Increase waste collection efficiency by 90%. ‘apes con/ste tui dabin apt Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDSmart Street Lights + Light sensor, motion sensor + Cellular loT + Real-time mesh network Street Lighting System (SaaS) to > ape ces se een mat et Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDSmart Street Parking + In the past year, how many times did you give up when looking for a parking space in cities? How many times did you argue with someone about a parking spot? On average, how long did you take to look for a parking spot? + More than 30% of a city’s traffic is caused by drivers searching for a parking spot. + In New York City, 29% of commuters said that they spent 20 minutes on average looking for a parking spot and 10% spent more than 40 minutes Satan Tec-US-Cies hd Copyright Smart Street Parking + Infiared- and magnetic-based vehicle detection sensor mounted on the road surface + Zigbee, LoRaWAN wireless connections __-.-------. + Mesh networks are implemented with.” in street lights + Apps to direct drivers to empty spaces + Dynamic parking prices 2017 Stanford University. ALL RIGHTS RESERVED.Smart Street Parking in Poland Security without Surveillance Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDSecurity without Surveillance + Real-time analytics rather than human-monitored surveillance + Edge-based analytics rather than cloud-based analytics + All videos are stored locally. This also reduces the requirement on datarate. + Resultant analytics sent fo central cloud database for issuing alerts Connected Vehicles 1 Yeu are comected to everyting you ned Yeucalyour omen” AQ wl << Oa Y 4 OO) = ‘You are dropped off Ba Sa Ra? SEO om’o ome om’® fctoseneee rome ap government 2020 dpe com end const eile Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDConnected Vehicles ~ Stages of Safety Innovation + Passive vehicle safety uses sensors to take the vehicle’s immediate surroundings into consideration, + Recent efforts enable the sharing of information gathered by the sensors between vehicles, and between vehicles and their surroundings to increase safety further. + VOX (vebicle-to-X, where X represents other vehicles, infrastructure, roads, and so on) A step towards autonomous driving Let’s Recap Sensors + Ultrasonic fill-level sensor + Light and motion sensors + Infrared- and magnetic-based vehicle detection sensor + Camera Communication Protocols + Cellular loT (LTE Cat-M1 and NB-IOT) + Zigbee, LoRaWAN + vox ‘Networking Protocols + Mesh network Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDOutline + Baby monitoring + Elderly monitoring + Mood enhancement + Disease treatment and progression monitoring, + Enhance adherence Baby Monitoring — Activity Tracking + Body position + Breathing + Oxygen level + Skin temp + Wakelsleep pattem * ECG Can be integrated with other ToT devices such as thermostat and camera to “close the loop”. For example, if the baby is too warm, the thermostat will automatically adjust Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDBaby Monitoring ~ Activity Tracking 1p. adnobaby coms io onlcee com smut tc Baby Monitoring — Activity Tracking The turtle sends information about the baby’s breathing, body position, sleep activity, and skin temp to the Lilypad via Bluetooth LE. . The Lilypad streams data and live audio to the cloud via WiFi Parents receive real-time insight about their baby on their smartphone. np aba cont Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDBaby Monitoring — Urinary Tract Infection Monitoring + Urinary tract infection (UTD) is the second most common infection in the US accounting for 7M hospital visits and 100,000 hospitalization per year. It is easy to cure if detected and treated in early stage. Urine culture test is accurate but time consuming. Dip stick test is fast but high false alarm rate. pests goal com se agparée project Baby Monitoring — Urinary Tract Infection Monitoring + Urine-activated paper battery (self-powered) + Paper-based colorimetric nitrite sensor consisting of an LED. a urine- absorbing strip, a reagent strip, an active photodiode, and a reference photodiode. + Sensor signal is converted into a PWM waveform. + BLE module transmits the PWM signal to the caregiver. Inge te anoe com amano ject cet Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDElderly Monitoring — Incontinence Management In most nursing homes, between 40% and 60% of residents suffer from urinary incontinence. Smart diaper allows caregivers to remotely detect if an incontinence event has occurred Improved quality and dignity of care by not having to disturb the elderly. np aioacomboatsewe aa ution com epee Elderly Monitoring — Fall Detection + One-fourth of Americans aged 65+ falls each year + Every 11 seconds, an older adult is treated in the emergency room for a fall; every 19 minutes, an older adult dies from a fall. + Falls are the leading cause of fatal injury and the most common cause of nonfatal trauma-related hospital admissions among older adults. + Falls result in more than 2.8 million injuries treated in emergency departments annually, including over $00,000 hospitalizations and more than 27,000 deaths. + In 2013, the total cost of fall injuries was $34 billion + The financial toll for older adult falls is expected to increase as the population ages and may reach $67.7 billion by 2020. (The medicare budget is $584 billion in 2016.) cere sth til prevention fs Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDElderly Monitoring — Fall Detection Fallmovenent data called by seas bee with {ota Techaalogy (© a ca senso ent oa Lat ues a Catena sens nfrmation tothe Clad where the {kta ieanaaed by snaps to eerine what ormaland wheal © Aepiction ever sens reports and ers on tefl {ndloion the penon toa computer abe deve co seutch com wiles ite fg dveloads Sentech Heal FalDetcie_ApoBie FINAL pt Mood Enhancement + Relaxing music could be cued to ease stress, + Window shades could be programmed to let in the maximum amount of, natural light. + Use IoT to encourage healthy behaviors. + Automatically dim the lights in the home at a recommended bedtime. + Automatically tum off the TV to encourage exercise. Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDMood Enhancing ~ Sleep Monitoring —— Disease Treatment and Progression Monitoring — Parkinson’s 60,000 Et New Patients with Parkinson’s disease must be continually assessed in order to keep up with their symptoms. This becomes potentially problematic as symptoms fluctuate on a constant basis, and a monthly check in with their doctor may not be representative of their experience. ape lidenentcnseefescre ot and ale t-te pasknecne Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDDisease Treatment and Progression Monitoring ~ Parkinson’s ‘sy-Aasa no emer er selena seu ean Instead of patients actively performing certain tasks, could we monitor disease progression passively in the background? mp prascampowe or) Disease Treatment and Progression Monitoring — Parkinson’s + ToT opens up new possibilities for disease treatment through remote monitoring. Using sensors, mobile devices, and advanced machine learning capabilities, a patient could keep track of a host of valuable data from mobility to sleep patterns all in real time. This information will give practitioners a more complete look into the progression of their patient's disease states. + Intel and Michael J. Fox Foundation for Parkinson’s Research, and Pfizer and. IBM are individually collaborating on this idea. The collaboration involves planned clinical trial. Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDEnhance Adherence + 84% of US. healthcare spending is on patients with chronic conditions. + More than 50% of prescribed medications are not taken as directed. + Reasons why people are not able to take their medication as directed: + They may forget + They may not be convinced of the medication’s effectiveness or be unsure that itis working. + They may fear the side effects or have difficulty taking the medication. + The rising cost of prescription medications is a barrier for many. Anteson G Clroi conditions: makina the cae for onsing cre Babine, MD. Jone Hops Univer 2010 Sate hence fo longterm therapies eence or acon Weld Heh reason 2003 Enhance Adherence — Ingestible Sensors a #) = np shronile com brine sce Di you ake yur plage emarecan- 1120689 Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDChallenges + A lack of Electronic Health Record (EHR) integration and concems about data security may prevent healthcare from fully adopting the IoT technology. + The need to adopt an integration-first mindset instead of keep building interesting/fun gadgets. Sometimes, a dump gadget can be as useful if it could integrate seamlessly with the EHR. Outline + Precision agriculture + Connected livestock + Food safety Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDPrecision Agriculture + A farming management concept based on observing, measuring and responding to inter and intra-field variability in crops. + In the past, precision agriculture technology was implemented by big agribusinesses due to high costs. + ToT technologies ~ which include everything from GPS services, sensors, and big data calculation ~ have made precision agriculture affordable by many farmers + Farmers don’t have to rely as much on their gut. Instead, they can make decisions based on detailed information about water, climate changes, soil quality, the health of their crops and livestock, and the conditions of their machinery. pe: Decco inelzencetot id macdonls am conected Fe Precision Agriculture q. 7 eae = - go = Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDPrecision Agriculture ‘Tr ee Pat ee Smtr Opportunities for Cass gee mmr vertical integration ‘ne hight com resnch apicuhure tech ashe map. companLi Connected Livestock + Around 1.4 billion cattle around the world + Animals can't tell you when they first get sick. It can be hard for humans to tell a cow is ill until there are visible signs of sickness. + ToT sensors cannot diagnose an illness but it will let the farmer know when something needs attention. Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDConnected Livestock + pH measurement + Early detection of fermentation disorders + Activity level measurement + Early, automatic oestrus detection + Onset illness + Temperature measurement Early detection of onset of diseases such as feverish disorders, metabolic disorders, post-calving disorders + Early detection of start of calving Inge ans coe Connected Livestock to oe, oe mr — oS omen, @ SS Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDFood Safety + Wifi or cellular connectivity | + When a produce recall is, initiated, the juice machine 4 will check the packs and ~~ prevent the machine from. pressing affected packs. ~ - ee Outline + Smart manufacturing + Smart packaging Copyright © 2017 Stanford University. ALL RIGHTS RESERVEDSmart Manufacturing + The use of IoT devices to improve efficiency and productivity of manufacturing operations. Typically, it involves retrofitting sensors to existing manufacturing equipment, But new manufacturing equipment often comes with IoT sensors pre-installed. + According to IDC data, published early 2017, the manufacturing industry was good for a total IoT spending of $178 billion in 2016, which is more than twice as much the second largest vertical market, transportation + Manufacturing operations accounts for 57.5% of the total IoT spending on manufacturing. np: bsie ie com tee 2017010405270 en eereSpending orcas Ceo Smart Packaging + Packaging systems used with food and pharmaceutical that help extend shelf life, monitor freshness, display information on quality, improve safety, and improve convenience + Usually involve active functions beyond the inert passive containment, for example, the ability to sense or measure an attribute of the product, the inner atmosphere of the package, or the shipping environment. This information can be communicated to users or can trigger other active packaging functions Copyright © 2017 Stanford University. ALL RIGHTS RESERVED