Does the LWC component support pre-validation before file get uploaded? I checked the js library doesnt seems have any way to do the validation.
No, it does no pre-validation at all. It is essentially just a mechanism to upload files to a record. If you want comprehensive validation, write your own component instead.