You're going to want to include a static.json file when deploying to Heroku:

{
  "root": "build/",
  "clean_urls": false,
  "routes": {
    "/**": "index.html"
  }
}

Other than that Heroku should just auto-detect that it is a static app.