Two Weapon Fighting with two light weapons?

Does the penalties for the Feat Two Weapon Fighting stop at -2/-2 while holding a one-handed weapon in your primary hand and a light one in your off-hand? What about while dual wielding light weapons like Rogues with the Dagger Master? Would the penalties be negated?