book

Programming Interactivity

Name: Programming Interactivity
Author: Joshua Noble
ISBN: 9780596154141

by Joshua Noble

July 2009

Beginner to intermediate

734 pages

22h 45m

English

O'Reilly Media, Inc.

Read now

Unlock full access

A Note Regarding Supplemental Files
Preface
Who This Book Is ForHow This Book Is OrganizedWhat Is—and Isn’t—in This BookWhat’s inWhat’s Not inCompanion WebsiteTypographical Conventions Used in This BookUsing Code ExamplesSafari® Books OnlineWe’d Like to Hear from YouAcknowledgments
I. Introductions
1. Introducing Interaction Design
What This Book Is forProgramming for InteractivityThe Nature of InteractionMessages and InteractionInterfaces and InteractionLanguages of InteractionDesign and InteractionArt and InteractionData Exchange and ExplorationWorking Process
2. Programming Basics
Why You’ll Read This Chapter More Than OnceThe Nature of CodeVariablesSimple TypesintSigned versus unsignedfloatcharbool or booleanstringbytelongArraysCastingOperatorsControl Statementsif/thenfor Loopwhile LoopcontinuebreakFunctionsDefining a FunctionPassing Parameters to a FunctionSome Suggestions on Writing FunctionsOverloading FunctionsObjects and PropertiesScopeReview
3. Processing
Downloading and Installing ProcessingExploring the Processing IDEThe Basics of a Processing ApplicationThe setup() MethodThe size() methodThe frameRate() methodThe print() methodThe draw() MethodThe Basics of Drawing with ProcessingThe rect(), ellipse(), and line() MethodsRGB Versus HexadecimalThe fill() MethodThe background() MethodThe line() MethodThe stroke() and strokeWeight() MethodsThe curve() MethodThe vertex() and curveVertex() MethodsCapturing Simple User InteractionThe mouseX and mouseY VariablesThe mousePressed() MethodThe mouseReleased() and mouseDragged() MethodsThe keyPressed and key VariablesImporting LibrariesDownloading LibrariesLoading Things into ProcessingLoading and Displaying ImagesThe PImage classThe loadImage() methodThe image() methodDisplaying Videos in the Processing EnvironmentUsing the Movie ClassReading and Writing FilesThe loadStrings() methodThe saveStrings() methodRunning and Debugging ApplicationsExporting Processing ApplicationsConclusionReview
4. Arduino
Starting with ArduinoInstalling the IDEMac OS XWindowsLinuxConfiguring the IDETouring Two Arduino BoardsThe ControllerDuemilanove Versus MiniWhat’s a pin?Digital versus analog pinsPins on the Mini versus DuemilanoveTouring the Arduino IDEThe Basics of an Arduino ApplicationThe setup StatementThe loop MethodFeatures of the Arduino LanguageConstantsMethodsArraysStringsHow to Connect Things to Your BoardHello WorldDebugging Your ApplicationImporting LibrariesRunning Your CodeRunning Your Board Without a USB ConnectionReview
5. Programming Revisited
Object-Oriented ProgrammingClassesThe Basics of a ClassClass RulesPublic and Private PropertiesInheritanceProcessing: Classes and FilesC++: Classes and Files.cpp and .hA Simple C++ ApplicationPointers and ReferencesReferencePointerWhen to Use PointersSome Rules for PointersPointers and ArraysWhen Are You Going to Use This?Review
6. openFrameworks
Your IDE and ComputerWindowsVisual StudioCode::Blocks for WindowsMac OS XLinuxCode::Blocks for LinuxUsing makefilesTaking Another Quick Tour of C++Basic Variable TypesArraysMethodsClasses and Objects in C++Getting Started with oFTouring an oF ApplicationMethodsVariablesCreating “Hello, World”Drawing in 2DSetting Drawing ModesDrawing PolygonsDisplaying Video Files and ImagesImagesVideoImporting LibrariesofxOpenCvofxVectorGraphicsofxVectorMathofxNetworkofxOscCompiling an oF ProgramCompiling in XcodeCompiling in Code::BlocksDebugging an oF ApplicationUsing the printf StatementUsing the GNU DebuggerUsing the Debugger in XcodeUsing the Debugger in Code::BlocksReview
II. Themes

7. Sound and Audio
Sound As FeedbackSound and InteractionHow Sound Works on a ComputerAudio in ProcessingInstantiating the Minim LibraryGenerating Sounds with MinimFiltering Sounds with MinimSound in openFrameworksopenFrameworks and the FMOD Ex LibraryThe Sound Object LibraryThe Magic of the Fast Fourier TransformPhysical Manipulation of Sound with ArduinoA Quick Note on PWMCreating Interactions with SoundFurther ResourcesReview
8. Physical Input
Interacting with Physical ControlsThinking About KineticsGetting Gear for This ChapterControlling ControlsThe Button As an Electrical ObjectThe Button As an Interactive ObjectThe Button As a Value in CodeTurning KnobsThe Dial As an Interactive ObjectPotentiometersUsing LightsWiring an LEDDetecting Touch and VibrationReading a Piezo SensorGetting Piezo SensorsCommunicating with Other ApplicationsSending Messages from the ArduinoopenFrameworksDetecting MotionPIR Motion SensorReading DistanceReading Input from an Infrared SensorUnderstanding Binary NumbersBinary NumbersBits and Bit OperationsWhy Do You Need to Know Any of This?Detecting Forces and TiltIntroducing I2CWhat Is a Physical Interface?What’s NextReview
9. Programming Graphics
The Screen and GraphicsSeeing Is Thinking, Looking Is ReadingMath, Graphics, and Coordinate SystemsDrawing StrategiesUse Loops to DrawUse Arrays to DrawDraw Only What You NeedUse SpritesProcessing and Transformation MatricesCreating MotionShaping the GazeSetting the MoodCreating TweensUsing VectorsUsing Graphical ControlsControlP5 LibraryEvent HandlingImporting and Exporting GraphicsUsing PostScript in ProcessingUsing PostScript Files in oFWhat’s NextReview
10. Bitmaps and Pixels
Using Pixels As DataUsing Pixels and Bitmaps As InputProviding Feedback with BitmapsLooping Through PixelsManipulating BitmapsManipulating Color BytesUsing Convolution in Full ColorAnalyzing Bitmaps in oFAnalyzing ColorAnalyzing BrightnessDetecting MotionUsing Edge DetectionUsing Pixel DataUsing TexturesTextures in oFTextures in ProcessingSaving a BitmapWhat’s NextReview
11. Physical Feedback
Using MotorsDC MotorsStepper MotorsOther OptionsUsing ServosConnecting a ServoCommunicating with the ServoWiring a ServoUsing Household CurrentsWorking with AppliancesIntroducing the LilyPad BoardUsing VibrationUsing an LED MatrixUsing the Matrix LibraryUsing the LedControl LibraryUsing the SPI ProtocolUsing LCDsSerial LCDUsing Solenoids for MovementWhat’s NextReview
12. Protocols and Communication
Communicating Over NetworksUsing XMLUnderstanding Networks and the InternetNetwork OrganizationNetwork IdentificationNetwork Data FlowHandling Network Communication in ProcessingClient ClassServer ClassSharing Data Across ApplicationsUnderstanding Protocols in NetworkingUsing ofxNetworkCreating Networks with the ArduinoInitializing the Ethernet LibraryCreating a Client ConnectionCreating a Server ConnectionUsing Carnivore to CommunicateInstalling the Carnivore LibraryCreating a Carnivore ClientCommunicating with BluetoothUsing Bluetooth in ProcessingInstalling Bluetooth on Linux and WindowsInstalling Bluetooth on Mac OS XUsing the bluetoothDesktop LibraryUsing the Arduino BluetoothCommunicating Using MIDIReview
III. Explorations
13. Graphics and OpenGL
What Does 3D Have to Do with Interaction?Understanding 3DWorking with 3D in ProcessingLighting in ProcessingControlling the Viewer’s PerspectiveMaking Custom Shapes in ProcessingUsing Coordinates and Transforms in ProcessingWorking with 3D in OpenGLSo, What Is OpenGL?TransformationsOpenGL in ProcessingOpen GL in openFrameworksUsing Matrices and Transformations in OpenGLUsing Vertices in OpenGLDrawing with Textures in oFLighting in OpenGLBlending Modes in OpenGLUsing Textures and Shading in ProcessingApplying Material PropertiesUsing Another Way of ShadingWhat Does GLSL Look Like?Vertex ShadersFragment ShaderVariables Inside ShadersUsing an ofShader AddonWhat to Do NextReview
14. Detection and Gestures
Computer VisionInterfaces Without ControlsExample CV ProjectsOpenCVUsing Blobs and TrackingStarting with ofxOpenCVTracking Blobs with ofxOpenCVTaking a quick foray into virtual methodsUsing the velocity of blobsUsing OpenCV in ProcessingExploring Further in OpenCVDetecting GesturesUsing ezGestures in ProcessingUsing Gestures in oFImplementing Face RecognitionExploring Touch Devices with oFTouchKitTuioTouchlibreacTIVisionWhat’s NextReview
15. Movement and Location
Using Movement As and in InteractionUsing Software-Based Serial PortsUnderstanding and Using GPSStoring DataLogging GPS Data to an ArduinoUsing the Breadcrumbs LibraryImplementing Hardware-Based LoggingSending GPS DataDetermining Location by IP AddressWhat to Do NextReview
16. Interfaces and Controls
Examining Tools, Affordances, and AestheticsReexamining TiltExploring InputShieldUnderstanding TouchExploring Open Source Touch HardwareNort_/DLiquidware TouchShieldDrawing to the TouchShield ScreenControlling Servos Through the TouchShieldSetting Up Communication Between Arduino and TouchShieldCommunicating Using OSCUsing the WiimoteUsing the Wii Nunchuck in ArduinoTracking Wii Remote Positioning in ProcessingWhat’s NextReview
17. Spaces and Environments
Using Architecture and SpaceSensing Environmental DataUsing an XBee with ArduinoCreating a Simple TestConfiguring the XBee ModuleAddressing in the XBeeXBee Library for ProcessingPlacing Objects in 2DUsing the X10 ProtocolSetting Up an RFID SensorReading Heat and HumidityWhat’s NextReview
18. Further Resources
What’s Next?Software ToolsARToolKitPureDataMax/MSPvvvvFlashConstruction ProcessesArtificial IntelligenceNeural netsPathfindingGenetic algorithmsArtificial lifePhysicsChipmunkBox2DOther Processing physics librariesofAddonsHardware PlatformsPhidgetsRobotshop RoverFritzingAVRARMPICBibliographyInteraction DesignProgrammingHardwareArtConclusion
A. Circuit Diagram Symbols
Programming Glossary
Index
Colophon
Copyright

Overview

Make cool stuff. If you're a designer or artist without a lot of programming experience, this book will teach you to work with 2D and 3D graphics, sound, physical interaction, and electronic circuitry to create all sorts of interesting and compelling experiences -- online and off.

Programming Interactivity explains programming and electrical engineering basics, and introduces three freely available tools created specifically for artists and designers:

Processing, a Java-based programming language and environment for building projects on the desktop, Web, or mobile phones
Arduino, a system that integrates a microcomputer prototyping board, IDE, and programming language for creating your own hardware and controls
OpenFrameworks, a coding framework simplified for designers and artists, using the powerful C++ programming language

BTW, you don't have to wait until you finish the book to actually make something. You'll get working code samples you can use right away, along with the background and technical information you need to design, program, build, and troubleshoot your own projects. The cutting edge design techniques and discussions with leading artists and designers will give you the tools and inspiration to let your imagination take flight.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

What Successful Brick-and-Mortar Retailers Get Right

Publisher Resources

ISBN: 9780596800598Errata Page

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills