• Technology and the Observation of Natural Environments

    Observation is essential to scientific discovery. In situ observation of natural environments is increasingly facilitated by new media and sensing technologies. These technologies not only enable the observation of complex---and at times sparse---ecological dynamics but provide new avenues for near real-time documentation, sharing, and discussion of these observations.

  • Collaborative Signal Processing

    Exploring optimization methods for human-machine processing collaboration in the context of the identification and localization of remote sound sources.

  • Bounding Ellipsoid Optimization

    Bounding ellipsoids approximate complex polytopes with well behaved and easy to manipulate algebraic representations. Many such polytopes emerge from constraint-based formulations of phenomena in engineering and science where linear models are accommodated with assumptions on worst case deviations.

  • Machine Understanding of Musical Harmony

    Machine harmonic transcription of Jazz music investigates algorithmic methods for mimicking human understanding of Jazz harmonies. It combines the short-term set-estimation of musical chords, the modeling and analysis of chord sequences patterns, and a higher-level understanding of Jazz. Jazz music is particularly challenging in that it purposefully accommodates dissonance and ambiguity in enriching the improvisational environment.

  • This work explores how technologies that augment
    our understanding of bird populations in order to allow these populations
    to speak to us about their habitat. In particular, in this collaboration
    between the MIT Media Laboratory and the Maine Audubon Society, we use
    cellular technology augment the process by which a group of volunteers
    collect information for an OWL census in Maine.

    The methodology was developed in a pilot census of Connecticut's owl
    population, conducted in the summer of 2006. In this study, we
    demonstrated that the audio quality of cell phones was sufficient for the
    discovery and interaction with owls. In this project, the cell phone is
    used to make the owl call and to record the response. The success of the
    pilot suggests that this small, portable technology can replace the
    conventional high-quality audio survey broadcasting and recording
    equipment.

    In our work in Maine we will deploy more cell nodes for calling owls and
    recording their response. We anticipate that each deployed node will
    result in to be several hours of recording per night per phone. In order
    to not overwhelm, individual volunteers who participate in the annotation
    of these audio streams, we are building a collaborative community that
    will assist in the task. A scheduling, annotation and database website
    will provide the backbone necessary for the volunteers to conduct and
    evaluate their experiments and, at the same time, will allow the public to
    participate in the processes of interpretation and annotation.

    With this project, we hope to gain insight into the social networking
    processes of collaborative interpretation and annotation of a shared
    database; knowledge representation for the bird-census domain; and the
    design issues involved in creating and maintaining a website for community
    scientific collaboration.

    The cellular survey may also provide data which suggest insights into
    questions about the hearing range of owls, duplication of vocalizing
    individual responses in adjacent experiment sites, the response rate of
    owls due to current weather or human presence, and comparison between
    trigger-based and naturally occurring responses in surveys. In addition,
    specific signal processing and communication technologies will be
    field-tested.

  • Machine harmonic transcription of Jazz music investigates algorithmic methods for mimicking human understanding of Jazz harmonies. It combines the short-term set-estimation of musical chords, the modeling and analysis of chord sequences patterns, and a higher-level understanding of Jazz. Jazz music is particularly challenging in that it purposefully accommodates dissonance and ambiguity in enriching the improvisational environment.

Array
digit seven, OBE filteringdigit seven, conventional filteringBU observation space 2DPre-processing sequence 5Pre-processing sequence 4Pre-processing sequence 3Pre-processing sequence 2Pre-processing sequence 1OBE outer approximationhyperstrips intersecting
Ultimate DFPetron BoxPetron Parabolaenclosure laser cut green in bush 1enclosure laser cut red with speaker nightenclosure modeling 3enclosure modeling 2enclosure modeling 13D printed enclosure, not colored with phoneSix-mic prototype
person watching world map on a computerworld map with emanating sounds and abnormal heartbeatworld map with emanating sounds and normal heartbeatworld map with emanating soundsworld map simplified and approximatedowl project: parsing owl calls behind internetowl project: listening to owl calls behind internetowl project: people networked on phonesowl project: people networked on computersowl project: logging info into computer
screech owl at audubon blue hillsBarred owl at audubon, blue hill, bostonaudubon: blue hill, boston great horned owlCurious Barred Owl of MaineBarred Owl at Blue Hill Audubon, MAScreech Owl at Blue Hill Adubon, MAGHO Owl at Blue Hills Audubon MA
Proposed Scheduler UIUltimate DFPetron Boxenclosure in dark with funnelswebsite explore 3/20083D printed enclosure, not colored with phoneSix-mic prototypeHanger and PhoneHanger, Amp
AUV lecture posterOwlProject UROP ad 10/2007Owl Project PosterDavid - Adventure Ecology - presentationBounding Ellipsoid Optimization IAP 08Observing the Natural Environment Class Spring 08
six mic input signalsearly six-microphone apparatus3D localization3D OBE localization