How to configure/customize new Sidebar(brought instead of old horizontal tab bar) in the new Lightning Experience? Like adding or removing objects?
this feature will be coming out in Spring '16. Please see this link to Trailhead:
It is available in Spring '16 under setup -> Navigation Menu. However you have to first enable lightning experience and access lightning experience based setup instead of classic.