Get Tasks Authorization Failed

I am getting {"type":"error","status":404,"code":"not_found","help_url":"http://developers.box.com/docs/#errors","message":"Authorization Failed","request_id":"redacted"} when I call https://api.box.com/2.0/tasks/{task_id} though I have no issue listing all tasks using the same token with https://api.box.com/2.0/files/{file_id}/tasks