Josh Clark speaking at An Event Apart Orlando 2016 at Disney’s Contemporary Resort in Walt Disney World on October 4, 2016.
We suddenly live in a strange and wonderful nexus of digital and physical. Touchscreens let us hold information in our hands, and we touch, stretch, crumple, drag, and flick data itself. Our sensor-packed phones even reach beyond the screen to interact directly with the world around us. While these digital interfaces are becoming physical, the physical world is becoming digital, too. Objects, places, and even our bodies are lighting up with with sensors and connectivity. We’re not just clicking links anymore; we’re creating physical interfaces to digital systems. This requires new perspective and technique for web and product designers. The good news: it’s all within your reach. With a rich trove of examples, Designing for Touch author Josh Clark explores the practical, meaningful design opportunities for the web’s newly physical interfaces.
Notes
- Curious Rituals: A design fiction film that explores new kind of digital habits in the near future
- We’re forced to bend to the technology instead of the reverse
- We feel trapped by the technology
- There are a million ways we could get this wrong—so let’s think hard about how we might get this right
- You can now touch data like a physical object (e.g. iPad, iPhone)
- Our job as designers is to translate intent into action
- We are going from digital to physical (or perhaps digital to more human)
- We are also going from physical to digital
- The smartphone is the first huge IoT device
- Mobile gives computing power to immobile objects
- The web has sensor savvy, too
- JavaScript APIs Current Status
- Record audio & video
- Understand speech
- Make & hear sound
- GPS location
- Vibrate
- Video conference
- Accelerometer
- Ambient light
- Do this today
- JavaScript APIs Current Status
- Where do we go from here?
- Four kinds of physical interfaces:
- Sensor input to the web
- Propeller
- Amazon Dash Button—Tide button on your washing machine
- “Generally, you don’t see that kind of behavior in a major appliance.” — Bill Murray
- You can buy a programable Amazon AWS IoT Button
- bt.tn
- IFTTT
- Do this today
- Notification from the web
- Glowcaps
- This is the interface, app, and browser
- Web ≠ Browser
- Ringly
- Lechal
- Mailchimp: Oliver—a visual display of your inbox
- Glowcaps
- Physical avatar of digital info
- Google has cataloged 1 billion entities, people, places & things — “Google’s Go-To-Market Gap”
- Connected Paper
- Unlock data in physical objects (e.g. QR codes)
- Lifeprint
- Each brand of smart devices has their own phone app that’s needed to control
- Where’s the universal connector network?
- Introduction to the Physical Web (100 days of Google Dev)
- The Physical Web
- Physical interaction
- Presto
- Grab Magic
- Push the possibilities of everyday devices
- It’s not a challenge of technology, it’s a challenge of imagination
- Reality Editor
- Screens configure, objects operate
- Open Hybrid
- What if there’s no screen at all?
- Amazon Echo
- This is the thing beyond the phone
- One interface for over 300 services
- Amazon Developer
- Sensor input to the web
- Why do we make it? To whose benefit?
- The goal is not to make things talk, it’s to improve the conversation
- Ethical Design Manifesto
- Wayfindr
- Wink: Robot Butler
- “How smart does your bed have to be before you’re afraid to go to sleep at night?” — Rich Gold
- Give the robots good values & good manners
- Amplify your humanity
- Check the values of your creation
- Designing for Touch by Josh Clark
Speaker Links and Resources
- Web APIs for sensor-based UI
- Other APIs and dev environments
- Physical Web
- IFTTT: If This Then That
- Alexa Skills Kit for making Alexa apps
- Wayfindr standard for beacon-based wayfinding
- Open Hybrid for connected devices
- Presto Android gesture control with smartwatch
- Reality Editor augmented reality for connecting devices
- Examples/videos from the talk
- Nappy Notifier
- Propeller Health asthma control
- Amazon Echo
- Amazon Dash button
- Bluetooth buttons: bt.tn and flic
- Ringly notification ring
- Lechal map shoes
- Glowcaps medication reminder
- Mailchimp Oliver (also: the whole series)
- Lifeprint video photographs
- THAW phone/screen interaction
- Happy Together music transfer (github)
- Presto smartwatch gesture control
- Grab Magic tv/phone sharing
- Reality Editor for connecting objects
- Wink Robot Butler
- Wayfindr subway navigation for the blind
- Framing the imaginative opportunity
- Of Nerve and Imagination by Josh Clark
- Magical UX and the Internet of Things (video)
- Enchanted Objects (book) by David Rose
- Hazards of Prophecy (pdf) from Profiles of the Future by Arthur C. Clarke
- The Future Mundane by Nick Foster
- #IoTH: The Internet of Things and Humans by Tim O’Reilly
- Ethics and values for the physical interface
- IOT Design Manifesto: guidelines for responsible design
- The Ethical Design Manifesto: a response to surveillance capitalism
- The Coming Age of Calm Technology by Aral Balkan
- The Nature of the Self in the Digital Age by Mark Weiser and John Seely Brown
- Connected // Disconnected by Josh Clark
- Wearables and Our Dysfunctinoal Obsession with Screens and Engagement
- Living with the Algorithm by Josh Clark
- Smartwatches, Wearables and that Nasty Data Rash by Josh Clark
- Speculative fiction for potential futures
- Curious Rituals
- Teacher of Algorithms
- TBD Catalog
- How smart does your bed have to be, before you are afraid to go to sleep at night? by Rich Gold
- Addicted Products: the story of Brad the toaster (video)
- Ethical Things: a fan that makes moral choices
- Black Mirror tv series (Netflix)