[PropertyInfo] Support using the SerializerExtractor with no group check

| Q            | A
| ------------ | ---
| Feature PR   | symfony/symfony#37040
| PR author(s) | @GuilhemN
| Merged in    | 5.2-dev