Yes you really do need to. Real people sort our recycling by hand so be considerate and think of them. Plus food remnants contaminate whatever you are trying to recycle.
Don’t just rinse your meat trays either. Their clever design holds all that ‘juice’ in its cavities so they need a good scrub.