Dr. Maxwell's E90 Project Ideas

Building a pan-tilt mount for a stereo camera system

  • A pan-tilt mount is a device that can rotate a load around two axes. Panning is horizontal rotation, and tilting is vertical rotation. For an example of a pan-tilt device, check out http://www.DPerception.com/. In order for a robot, or other visual human-computer interface station to have a flexible vision system that can orient on something of interest, it must have the ability to rotate. The goal of this project would be to design a cost-effective pan-tilt head for two cameras (about a 4 lbs load) that could be controlled through the serial port of a computer. If successful, such a device could have commercial potential, as pan-tilt heads typically cost $2000 and up.
  • One or two students would be appropriate for this project, which will involve control theory, working with motors, computer-device communication, and programming a microcontroller or FPGA.

Hors D'oeurves Anyone?

  • Each year, the American Association for Artificial Intelligence holds a robot competition. This year the competition has two parts: Life on Mars, and Hors D'Oeurves Anyone?

    The Life on Mars comptetition has robots go around a closed area with "stuff" in it like colored balls and polyhedra. The robots are supposed to avoid certain things, identify and pick up others, and generate a map of their environment.

    The Hors D'oeurves Anyone? competition has robots serve hors d'oeurves at a reception. This is a real-world task with no bounds, human-computer interaction, lots of noise, and people who try to make the robot screw up. For more information on the competition, check out http://www.cc.gatech.edu/aimosaic/robot-lab/aaai98/.

    Dr. Maxwell led the winning team for the 1998 Hors D'oerves Anyone competition, and would like to take a team of Swarthmore students back to try again in 1999. Some of the things that need doing include: 1) the development of a reliable people-finder, 2) the design and implementation of an algorithm that can "work" a crowd, 3) the design and customization of the robot (which we will purchase this fall) to enable it to interact with people, 4) the development of a trainable vision system for identifying specialty items such as conference badges, red beverage cups, and other useful things, 5) integrating a speech recognition system with the robot to allow more sophisticated human-computer interaction.

  • Up to 5-7 students could work on various aspects of this project, which will be a good hands-on introduction to robots, computer vision, and speech recognition.

Navigating Hicks with one or more robots

  • Having robots navigate and map buildings is necessary for them to start to do useful things like collect and distribute mail, look for and find people, and other useful tasks (be creative). Navigating Hicks offers many challenges, including forcing the robot to be able to find and use the elevator. In order to be successful at this task, we would need to design and build an elevator button pusher, and then implement some kind of mapping system based on both sonar and vision. It is likely we could have two robots doing this task, so cooperation is possible. (We could also have the robots try to play hide and go seek, which could be very interesting to program and watch).
  • Up to 4-5 students could work on various aspects of this task, many of which overlap with the other robot tasks described herein.

Robot vision: mapping what the robot sees and identifying landmarks

  • This is a standard problem in robotics/computer vision. Typically, roboticists use easy-to-spot landmarks like bar codes or brightly colored patterns. For a robot to navigate successfully in a non-specialized environment, it must be able to find and remember natural landmarks.
  • One or two students could work on this project, which will involve mostly programming and testing out different object recognition/detection techniques.

Computer graphics project: going for realism in textures and colors

  • There are numerous directions that projects in computer graphics could take. Dr. Maxwell's personal interest is in creating realistic scenes using physics-based models and complex textures and colors, but student ideas are welcome.
  • Any number of students could work on appropriate projects in computer graphics. These projects will include physical modeling of object properties, physics-based models of light-matter interaction, some numerial algorithms, and a significant amount of programming in computer graphics.

Pattern recognition & segmentation for automatic typology generation with hydrogeological data

  • This is a project that Dr. Maxwell is currently working on with a Hydrogeologist in Kansas. The LOICZ data set is a hydrogeologic data set that contains data from coastlines around the world. Hydrogeologists are currently using this data to develop a typology of coastlines (is Antarctica like New England?). I am using computer vision/pattern recognition segmentation and clustering techniques to do a data-driven classification of the coastlines. There are multiple computer vision techniques which are appropriate to this task, and an E90 project could focus on applying 2-3 of them and comparing the results. This is a "hot" problem in hydrogeology and there is a high probability of getting a paper published from this project.
  • One or two students would be appropriate for this task, which will involve programming and visualization of large scientific data sets.

Designing a vision-based object recognition/detection system

  • This project is similar to parts of the robot projects above, but can take different directions. At the very least it will involve writing one ormore programs that can detect and/or identify objects in an image. This project could use existing data sets (such as a 100 object data set made available by Columbia University), it could involve making a data set, or it could involve searching pictures on the web.
  • One or two students would be appropriate for this project, which will involve most programming and probably some numerical receipes-type algorithms.

Designing a keypad security system for the Hicks labs

  • Ever forget your key and couldn't get into your lab when the project is due the next day? This project would involve putting in a keypad security system for one or more of the Hicks labs so that students could have a pass code rather than a physical key.
  • Up to two or three students could work on various aspects of this project (or different labs), which will involve digital logic design, and integration with a microcontroller to run the system