Integrate with Slack to Get Daily Reports on Broken Links

Setup Instructions

1. Create a Slack App: Use the following manifest:
   

   {
     "display_information": { "name": "opencrawler" },
     "features": { "bot_user": { "display_name": "opencrawler", "always_online": false } },
     "oauth_config": {
       "redirect_urls": ["<hosteddomain-you-will-get-this-after-deploying-the-repo-in-below-step>/slack/events"],
       "scopes": { "bot": ["chat:write"] }
     },
     "settings": {
       "org_deploy_enabled": false,
       "socket_mode_enabled": false,
       "token_rotation_enabled": false
     }
   }

2. Go to this GitHub repository.
3. Deploy this repository on Vercel by clicking on the "Deploy" button.
4. Configure Environment Variables:
   • SLACK_SIGNING_SECRET - Your Slack app's signing secret
   • SLACK_BOT_TOKEN - The bot token generated for your Slack app
   • SLACK_CHANNEL - The ID of the Slack channel where notifications will be sent
5. Set Up a Cron Job:
   • Go to cron-job.org for automation.
   • Set up a cron job to run the API endpoint

     https://opencrawler-backend.onrender.com/add-job

   • Click on "Advanced Settings" and change the request type from GET to POST.
   • Add the following body to the request:

     {
       "email": "test@test.com",
       "url": "https://test.com/",
       "mode": "deepscan",
       "postActionApi": "http://<replace-with-deployed-vercel-url>/api/slack"
     }

   • Click "Save," and thats it now you will get daily reports on broken links in your slack channel(Currently you will receave message only if there are broken links.you can make necessary change in repo to get message even if there are no broken links).