AdlFileSystem: SetOwner intermittently fails

[kdpak]

I have a simple script that uses Hadoop CLI to do create and setOwner continuously in the following way:

1. hadoop fs -put /some/file fooX
2. hadoop fs -chown username:groupname fooX
3. X++
4. back to step 1.

This works most of the time, but intermittently, the setOwner call fails with:

Exception in thread "main" org.apache.hadoop.security.AccessControlException: Set Owner failed with failed with error 0x83090aa2 (Forbidden. ACL verification failed. Either the resource does not exist or the user is not authorized to perform the requested operation.).

The service principal used has owner-level access and we're using the same username and group on every call so my suspicion is that sometimes, the file doesn't exist at the time of setOwner. Is it possible that in some situation, read-after-write consistency isn't met and the file is not created at the time of chowning?

This is with hadoop-azure-datalake-2.7.3.2.6.4.0-91 and azure-data-lake-store-sdk-2.1.4. Please let me know what other info I can provide.

[rahuldutta90]

@kdpak This looks like a user error. Did this get resolved?