We've been reading all your feedback and we're going to be making further changes today. These changes will include the ability to opt-out / opt-in to the PvP Seasons and we'll also be removing inactivate players from it.
In addition to this, all targets within the PvP Season will be selected from no lower than one league below your own. For example, a Crystal player will never be matched with a player lower than Gold.
All players will be given the option to opt-out, however if you wish to opt back in you will need to wait for the next PvP Season to start.