CSRF Check failed -- Access Forbidden on new installations

When having such issues it really help to use the search functionality at the top right. When putting “CSRF Check failed” into that search you will stumble over the following existing FAQ explaining that your server is mis-configured an shows example how to configure it correctly: