The best way to begin is to pick up just a few signs that your baby will enjoy (mama, more, milk, daddy....) and sign them consistently with your baby. For example, when you feed her, tell her "this milk is good" and sign milk at the same time, so she can make the connection between the object, the word and the sign (don't sign milk out of context, she would not understand. She sees milk, hears "milk" and sees the sign all together).
Even though your library doesn't have much, you may find some baby signing time DVDs there. We used them to teach my children and I highly recommend them (my son learned signs, as well as English, sharing, saying please, thank you, sorry...thanks to Rachel Coleman)
In last resort, YouTube has some Signing Time clips too.