Can Airflow Do this?
If you're a Airflow developer the configuration page in the documentation is a gold mine. Most of the times someone asks Can Airflow do this? the answer lies in the configurations page.
Infact I have this page bookmarked in my browser forever. There are so many configurations to tweak different airflow components.
Ensure all the dags run only the future runs irrespective of their start date. You can also set this at each dag level.
There is a whole page in Airflow docs on which config params to tweak to use the available resources effectively
**** This is a new configuration in 2.3.0 but also an odd one out. Setting this to true will create default Airflow connections in the metadata DB
Manage sqlalchemy pool using