The outer rubber is integral to the alloy window strips which just lift in an upwards direction for removal. Sometimes they can be a little troublesome but a bit of a wiggle normally works.
Once removed you should be able to clean the rubbers up and up and re-assemble.