Victoria should think carefully before removing a rail crossing from the Johnson Street bridge project, say some local politicians.