Refine condition, for ignoring types when using PolymorphicModelConverter

**Is your feature request related to a problem? Please describe.**

- If a field declares a `Schema` annotation, `oneOf` or `allOf`. use the Schema provided types, instead of automatic processing by `PolymorphicModelConverter`