Webpack .css files?

I am trying to learn some basic webpaci. I get this error:

You may need an appropriate loader to handle this file type.
| import './index.css'

and I think that has to do with that it doesnt exist in the package?

You need to install loaders to handle css files in webpack.

Use this guide as start.