Agents assigned to a Task cannot close it unless they are also a member of the task's department.

This is currently expected behavior -- Task permissions are evaluated based on the Task's Department, not based on assignment fallback like Tickets. There is no workaround other than adding the agent to the department.