You can make your own musical instruments with materials you probably already have on hand. These instructions will help you make instruments like bean shakers and kazoos appropriate for older babies and toddlers. For older children, you can get a little more sophisticated and make instruments like finger cymbals and tamborines.
Continue the music-making theme:

