Bug 1679744 - Minio gateway nas does not work with 2 + 1 dispersed volumes
Summary: Minio gateway nas does not work with 2 + 1 dispersed volumes
Keywords:
Status: CLOSED UPSTREAM
Alias: None
Product: GlusterFS
Classification: Community
Component: disperse
Version: 4.1
Hardware: x86_64
OS: Linux
medium
medium
Target Milestone: ---
Assignee: Pranith Kumar K
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-02-21 18:26 UTC by Otavio Cipriani
Modified: 2020-03-12 12:46 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-03-12 12:46:33 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github minio minio issues 7262 0 'None' closed Minio gateway nas stuck in FUTEX_WAIT_PRIVATE 2020-10-05 18:18:43 UTC

Description Otavio Cipriani 2019-02-21 18:26:32 UTC
Description of problem:

When starting Minio as a NAS gateway over GlusterFS, a FUTEX_WAIT_PRIVATE system call never returns.

The problem does not happen when using a local filesystem, neither over NFS. It also does not occur when using 3-way replicated or 4 + 2 dispersed volumes.

## Expected Behavior
Minio should work over GlusterFS.

## Current Behavior
Minio never finishes starting. It gets stuck in a FUTEX_WAIT_PRIVATE system call. Here is the output of `env MINIO_ACCESS_KEY=admin MINIO_SECRET_KEY=password MINIO_REGION=sa-central-1 strace /usr/local/bin/minio gateway nas --certs-dir /usr/local/etc/minio/certs /var/local/lib/minio`:

```
execve("/usr/local/bin/minio", ["/usr/local/bin/minio", "gateway", "nas", "--certs-dir", "/usr/local/etc/minio/certs", "/var/local/lib/minio"], [/* 26 vars */]) = 0
arch_prctl(ARCH_SET_FS, 0x2612bb0)      = 0
sched_getaffinity(0, 8192, [0 ...])     = 640
mmap(NULL, 262144, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f8929000
mmap(0xc000000000, 67108864, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xc000000000
mmap(0xc000000000, 67108864, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xc000000000
mmap(NULL, 33554432, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f6929000
mmap(NULL, 2162688, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f6719000
mmap(NULL, 65536, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f6709000
mmap(NULL, 65536, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f66f9000
rt_sigprocmask(SIG_SETMASK, NULL, [], 8) = 0
sigaltstack(NULL, {ss_sp=NULL, ss_flags=SS_DISABLE, ss_size=0}) = 0
sigaltstack({ss_sp=0xc000002000, ss_flags=0, ss_size=32768}, NULL) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
gettid()                                = 7977
rt_sigaction(SIGHUP, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGHUP, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGINT, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGINT, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGQUIT, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGQUIT, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGILL, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGILL, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGTRAP, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGTRAP, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGABRT, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGABRT, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGBUS, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGBUS, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGFPE, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGFPE, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGUSR1, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGUSR1, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGSEGV, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGSEGV, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGUSR2, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGUSR2, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGPIPE, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGPIPE, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGALRM, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGALRM, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGTERM, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGTERM, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGSTKFLT, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGSTKFLT, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGCHLD, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGCHLD, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGURG, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGURG, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGXCPU, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGXCPU, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGXFSZ, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGXFSZ, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGVTALRM, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGVTALRM, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGPROF, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGPROF, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGWINCH, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGWINCH, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGIO, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGIO, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGPWR, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGPWR, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGSYS, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGSYS, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRTMIN, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_1, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_2, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_2, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_3, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_3, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_4, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_4, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_5, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_5, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_6, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_6, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_7, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_7, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_8, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_8, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_9, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_9, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_10, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_10, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_11, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_11, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_12, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_12, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_13, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_13, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_14, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_14, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_15, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_15, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_16, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_16, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_17, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_17, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_18, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_18, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_19, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_19, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_20, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_20, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_21, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_21, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_22, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_22, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_23, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_23, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_24, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_24, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_25, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_25, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_26, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_26, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_27, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_27, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_28, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_28, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_29, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_29, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_30, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_30, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_31, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_31, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigaction(SIGRT_32, NULL, {SIG_DFL, [], 0}, 8) = 0
rt_sigaction(SIGRT_32, {0x45df70, ~[], SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, 0x45e0a0}, NULL, 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[], [], 8) = 0
clone(child_stack=0xc00006c000, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM) = 7978
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[], [], 8) = 0
clone(child_stack=0xc00006e000, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM) = 7979
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
futex(0x2612c60, FUTEX_WAIT_PRIVATE, 0, NULL) = 0
readlinkat(AT_FDCWD, "/proc/self/exe", "/usr/local/bin/minio", 128) = 20
fcntl(0, F_GETFL)                       = 0x8402 (flags O_RDWR|O_APPEND|O_LARGEFILE)
mmap(NULL, 262144, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f66b9000
fcntl(1, F_GETFL)                       = 0x8402 (flags O_RDWR|O_APPEND|O_LARGEFILE)
fcntl(2, F_GETFL)                       = 0x8402 (flags O_RDWR|O_APPEND|O_LARGEFILE)
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
openat(AT_FDCWD, "/proc/sys/net/core/somaxconn", O_RDONLY|O_CLOEXEC) = 3
epoll_create1(EPOLL_CLOEXEC)            = 4
epoll_ctl(4, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264576, u64=140406615170816}}) = 0
fcntl(3, F_GETFL)                       = 0x8000 (flags O_RDONLY|O_LARGEFILE)
fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK|O_LARGEFILE) = 0
read(3, "128\n", 65536)                 = 4
read(3, "", 65532)                      = 0
epoll_ctl(4, EPOLL_CTL_DEL, 3, 0xc0000b1a0c) = 0
close(3)                                = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
socket(AF_LOCAL, SOCK_DGRAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3
setsockopt(3, SOL_SOCKET, SO_BROADCAST, [1], 4) = 0
connect(3, {sa_family=AF_LOCAL, sun_path="/run/systemd/journal/socket"}, 30) = 0
futex(0x2612c60, FUTEX_WAIT_PRIVATE, 0, NULL) = 0
epoll_ctl(4, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264576, u64=140406615170816}}) = 0
getsockname(3, {sa_family=AF_LOCAL, NULL}, [2]) = 0
getpeername(3, {sa_family=AF_LOCAL, sun_path="/run/systemd/journal/socket"}, [30]) = 0
getpid()                                = 7977
getppid()                               = 7975
openat(AT_FDCWD, "/dev/tty", O_RDONLY|O_CLOEXEC) = 5
futex(0x2612c60, FUTEX_WAIT_PRIVATE, 0, NULL) = 0
epoll_ctl(4, EPOLL_CTL_ADD, 5, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264368, u64=140406615170608}}) = 0
fcntl(5, F_GETFL)                       = 0x8000 (flags O_RDONLY|O_LARGEFILE)
fcntl(5, F_SETFL, O_RDONLY|O_NONBLOCK|O_LARGEFILE) = 0
getuid()                                = 0
getgid()                                = 0
newfstatat(AT_FDCWD, "/usr/local/sbin/uname", 0xc0001c6518, 0) = -1 ENOENT (No such file or directory)
futex(0x2612c60, FUTEX_WAIT_PRIVATE, 0, NULL) = 0
newfstatat(AT_FDCWD, "/sbin/uname", 0xc0001c65e8, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/bin/uname", {st_mode=S_IFREG|0755, st_size=33168, ...}, 0) = 0
openat(AT_FDCWD, "/dev/null", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc00018379c) = -1 EPERM (Operation not permitted)
pipe2([7, 8], O_CLOEXEC)                = 0
epoll_ctl(4, EPOLL_CTL_ADD, 7, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = 0
fcntl(7, F_GETFL)                       = 0 (flags O_RDONLY)
fcntl(7, F_SETFL, O_RDONLY|O_NONBLOCK)  = 0
epoll_ctl(4, EPOLL_CTL_ADD, 8, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134263952, u64=140406615170192}}) = 0
fcntl(8, F_GETFL)                       = 0x1 (flags O_WRONLY)
fcntl(8, F_SETFL, O_WRONLY|O_NONBLOCK)  = 0
fcntl(8, F_GETFL)                       = 0x801 (flags O_WRONLY|O_NONBLOCK)
fcntl(8, F_SETFL, O_WRONLY)             = 0
fcntl(8, F_GETFL)                       = 0x1 (flags O_WRONLY)
fcntl(8, F_SETFL, O_WRONLY)             = 0
pipe2([9, 10], O_CLOEXEC)               = 0
getpid()                                = 7977
rt_sigprocmask(SIG_SETMASK, NULL, [], 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[], NULL, 8) = 0
clone(child_stack=0, flags=CLONE_VM|CLONE_VFORK|SIGCHLD) = 7982
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
close(10)                               = 0
read(9, "", 8)                          = 0
close(9)                                = 0
close(6)                                = 0
epoll_ctl(4, EPOLL_CTL_DEL, 8, 0xc000183864) = 0
close(8)                                = 0
waitid(P_PID, 7982, {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=7982, si_uid=0, si_status=0, si_utime=0, si_stime=0}, WEXITED|WNOWAIT, NULL) = 0
wait4(7982, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, {ru_utime={0, 513}, ru_stime={0, 0}, ...}) = 7982
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
newfstatat(AT_FDCWD, "/usr/local/sbin/uname", 0xc0001c6858, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/sbin/uname", 0xc0001c6928, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/bin/uname", {st_mode=S_IFREG|0755, st_size=33168, ...}, 0) = 0
openat(AT_FDCWD, "/dev/null", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc00018379c) = -1 EPERM (Operation not permitted)
pipe2([7, 8], O_CLOEXEC)                = 0
epoll_ctl(4, EPOLL_CTL_ADD, 7, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = 0
fcntl(7, F_GETFL)                       = 0 (flags O_RDONLY)
fcntl(7, F_SETFL, O_RDONLY|O_NONBLOCK)  = 0
epoll_ctl(4, EPOLL_CTL_ADD, 8, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134263952, u64=140406615170192}}) = 0
fcntl(8, F_GETFL)                       = 0x1 (flags O_WRONLY)
fcntl(8, F_SETFL, O_WRONLY|O_NONBLOCK)  = 0
fcntl(8, F_GETFL)                       = 0x801 (flags O_WRONLY|O_NONBLOCK)
fcntl(8, F_SETFL, O_WRONLY)             = 0
fcntl(8, F_GETFL)                       = 0x1 (flags O_WRONLY)
fcntl(8, F_SETFL, O_WRONLY)             = 0
pipe2([9, 10], O_CLOEXEC)               = 0
getpid()                                = 7977
rt_sigprocmask(SIG_SETMASK, NULL, [], 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[], NULL, 8) = 0
clone(child_stack=0, flags=CLONE_VM|CLONE_VFORK|SIGCHLD) = 7983
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
close(10)                               = 0
read(9, "", 8)                          = 0
close(9)                                = 0
close(6)                                = 0
epoll_ctl(4, EPOLL_CTL_DEL, 8, 0xc000183864) = 0
close(8)                                = 0
waitid(P_PID, 7983, {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=7983, si_uid=0, si_status=0, si_utime=0, si_stime=0}, WEXITED|WNOWAIT, NULL) = 0
wait4(7983, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, {ru_utime={0, 473}, ru_stime={0, 0}, ...}) = 7983
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
newfstatat(AT_FDCWD, "/usr/local/sbin/uname", 0xc0001c6b98, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/sbin/uname", 0xc0001c6c68, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/bin/uname", {st_mode=S_IFREG|0755, st_size=33168, ...}, 0) = 0
openat(AT_FDCWD, "/dev/null", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc00018379c) = -1 EPERM (Operation not permitted)
pipe2([7, 8], O_CLOEXEC)                = 0
epoll_ctl(4, EPOLL_CTL_ADD, 7, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = 0
fcntl(7, F_GETFL)                       = 0 (flags O_RDONLY)
fcntl(7, F_SETFL, O_RDONLY|O_NONBLOCK)  = 0
epoll_ctl(4, EPOLL_CTL_ADD, 8, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134263952, u64=140406615170192}}) = 0
fcntl(8, F_GETFL)                       = 0x1 (flags O_WRONLY)
fcntl(8, F_SETFL, O_WRONLY|O_NONBLOCK)  = 0
fcntl(8, F_GETFL)                       = 0x801 (flags O_WRONLY|O_NONBLOCK)
fcntl(8, F_SETFL, O_WRONLY)             = 0
fcntl(8, F_GETFL)                       = 0x1 (flags O_WRONLY)
fcntl(8, F_SETFL, O_WRONLY)             = 0
pipe2([9, 10], O_CLOEXEC)               = 0
getpid()                                = 7977
rt_sigprocmask(SIG_SETMASK, NULL, [], 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[], NULL, 8) = 0
clone(child_stack=0, flags=CLONE_VM|CLONE_VFORK|SIGCHLD) = 7984
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
close(10)                               = 0
read(9, "", 8)                          = 0
close(9)                                = 0
close(6)                                = 0
epoll_ctl(4, EPOLL_CTL_DEL, 8, 0xc000183864) = 0
close(8)                                = 0
waitid(P_PID, 7984, {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=7984, si_uid=0, si_status=0, si_utime=0, si_stime=0}, WEXITED|WNOWAIT, NULL) = 0
wait4(7984, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, {ru_utime={0, 467}, ru_stime={0, 0}, ...}) = 7984
getrandom("\204\234\370\334\267\237\340\345", 8, 0) = 8
getrandom("\31w\237\300\370\2329\343", 8, 0) = 8
getrandom("\0&\223\372I\\\2145\7)\211f", 12, 0) = 12
getrandom("\7\250\230\214\211\206\200\334\310\255=!", 12, 0) = 12
getpid()                                = 7977
newfstatat(AT_FDCWD, "/proc", {st_mode=S_IFDIR|0555, st_size=0, ...}, 0) = 0
openat(AT_FDCWD, "/proc/stat", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = 0
fcntl(6, F_GETFL)                       = 0x8000 (flags O_RDONLY|O_LARGEFILE)
fcntl(6, F_SETFL, O_RDONLY|O_NONBLOCK|O_LARGEFILE) = 0
read(6, "cpu  78425 20 74048 7128110 303 "..., 4096) = 785
read(6, "", 3311)                       = 0
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000183124) = 0
close(6)                                = 0
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
futex(0x2612190, FUTEX_WAKE_PRIVATE, 1) = 1
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0
ioctl(2, TCGETS, {B38400 opost isig icanon echo ...}) = 0
socket(AF_NETLINK, SOCK_RAW, NETLINK_ROUTE) = 6
bind(6, {sa_family=AF_NETLINK, pid=0, groups=00000000}, 12) = 0
sendto(6, "\21\0\0\0\26\0\1\3\1\0\0\0\0\0\0\0\0", 17, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, 12) = 17
recvfrom(6, "L\0\0\0\24\0\2\0\1\0\0\0)\37\0\0\2\10\200\376\1\0\0\0\10\0\1\0\177\0\0\1"..., 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 164
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
recvfrom(6, "H\0\0\0\24\0\2\0\1\0\0\0)\37\0\0\n\200\200\376\1\0\0\0\24\0\1\0\0\0\0\0"..., 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 144
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
recvfrom(6, "\24\0\0\0\3\0\2\0\1\0\0\0)\37\0\0\0\0\0\0", 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 20
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
close(6)                                = 0
socket(AF_NETLINK, SOCK_RAW, NETLINK_ROUTE) = 6
bind(6, {sa_family=AF_NETLINK, pid=0, groups=00000000}, 12) = 0
sendto(6, "\21\0\0\0\22\0\1\3\1\0\0\0\0\0\0\0\0", 17, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, 12) = 17
recvfrom(6, "\320\4\0\0\20\0\2\0\1\0\0\0)\37\0\0\0\0\4\3\1\0\0\0I\0\1\0\0\0\0\0"..., 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 2472
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
recvfrom(6, "\24\0\0\0\3\0\2\0\1\0\0\0)\37\0\0\0\0\0\0", 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 20
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
close(6)                                = 0
socket(AF_NETLINK, SOCK_RAW, NETLINK_ROUTE) = 6
bind(6, {sa_family=AF_NETLINK, pid=0, groups=00000000}, 12) = 0
sendto(6, "\21\0\0\0\26\0\1\3\1\0\0\0\0\0\0\0\0", 17, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, 12) = 17
recvfrom(6, "L\0\0\0\24\0\2\0\1\0\0\0)\37\0\0\2\10\200\376\1\0\0\0\10\0\1\0\177\0\0\1"..., 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 164
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
recvfrom(6, "H\0\0\0\24\0\2\0\1\0\0\0)\37\0\0\n\200\200\376\1\0\0\0\24\0\1\0\0\0\0\0"..., 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 144
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
recvfrom(6, "\24\0\0\0\3\0\2\0\1\0\0\0)\37\0\0\0\0\0\0", 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 20
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
close(6)                                = 0
socket(AF_NETLINK, SOCK_RAW, NETLINK_ROUTE) = 6
bind(6, {sa_family=AF_NETLINK, pid=0, groups=00000000}, 12) = 0
sendto(6, "\21\0\0\0\22\0\1\3\1\0\0\0\0\0\0\0\0", 17, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, 12) = 17
recvfrom(6, "\320\4\0\0\20\0\2\0\1\0\0\0)\37\0\0\0\0\4\3\1\0\0\0I\0\1\0\0\0\0\0"..., 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 2472
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
recvfrom(6, "\24\0\0\0\3\0\2\0\1\0\0\0)\37\0\0\0\0\0\0", 4096, 0, {sa_family=AF_NETLINK, pid=0, groups=00000000}, [12]) = 20
getsockname(6, {sa_family=AF_NETLINK, pid=7977, groups=00000000}, [12]) = 0
close(6)                                = 0
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
getrandom("\345\r\205\262m.\376Q", 8, 0) = 8
getrandom("\330\236\304sX\221\"\17\270a\246\305\335&?\315", 16, 0) = 16
getrandom("\261\237\327\262\251\212\263\237", 8, 0) = 8
getrandom("`\312'Gsi\273J", 8, 0)       = 8
newfstatat(AT_FDCWD, "/usr/local/bin/minio", {st_mode=S_IFREG|0755, st_size=35695328, ...}, 0) = 0
newfstatat(AT_FDCWD, "/usr/local/bin/minio", {st_mode=S_IFREG|0755, st_size=35695328, ...}, 0) = 0
newfstatat(AT_FDCWD, "/root/.minio", {st_mode=S_IFDIR|0700, st_size=6, ...}, 0) = 0
newfstatat(AT_FDCWD, "/usr/local/etc/minio/certs", {st_mode=S_IFDIR|0700, st_size=17, ...}, 0) = 0
newfstatat(AT_FDCWD, "/usr/local/etc/minio/certs/CAs", {st_mode=S_IFDIR|0700, st_size=6, ...}, 0) = 0
socket(AF_INET, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, IPPROTO_TCP) = 6
close(6)                                = 0
socket(AF_INET6, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, IPPROTO_TCP) = 6
setsockopt(6, SOL_IPV6, IPV6_V6ONLY, [1], 4) = 0
bind(6, {sa_family=AF_INET6, sin6_port=htons(0), inet_pton(AF_INET6, "::1", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, 28) = 0
socket(AF_INET6, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, IPPROTO_TCP) = 7
setsockopt(7, SOL_IPV6, IPV6_V6ONLY, [0], 4) = 0
bind(7, {sa_family=AF_INET6, sin6_port=htons(0), inet_pton(AF_INET6, "::ffff:127.0.0.1", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, 28) = 0
close(7)                                = 0
close(6)                                = 0
socket(AF_INET6, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, IPPROTO_IP) = 6
setsockopt(6, SOL_IPV6, IPV6_V6ONLY, [0], 4) = 0
setsockopt(6, SOL_SOCKET, SO_BROADCAST, [1], 4) = 0
setsockopt(6, SOL_SOCKET, SO_REUSEADDR, [1], 4) = 0
bind(6, {sa_family=AF_INET6, sin6_port=htons(9000), inet_pton(AF_INET6, "::", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, 28) = 0
listen(6, 128)                          = 0
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = 0
getsockname(6, {sa_family=AF_INET6, sin6_port=htons(9000), inet_pton(AF_INET6, "::", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, [28]) = 0
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc00045260c) = 0
close(6)                                = 0
socket(AF_INET, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, IPPROTO_IP) = 6
setsockopt(6, SOL_SOCKET, SO_BROADCAST, [1], 4) = 0
setsockopt(6, SOL_SOCKET, SO_REUSEADDR, [1], 4) = 0
bind(6, {sa_family=AF_INET, sin_port=htons(9000), sin_addr=inet_addr("0.0.0.0")}, 16) = 0
listen(6, 128)                          = 0
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = 0
getsockname(6, {sa_family=AF_INET, sin_port=htons(9000), sin_addr=inet_addr("0.0.0.0")}, [16]) = 0
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc00045260c) = 0
close(6)                                = 0
socket(AF_INET6, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, IPPROTO_IP) = 6
setsockopt(6, SOL_IPV6, IPV6_V6ONLY, [1], 4) = 0
setsockopt(6, SOL_SOCKET, SO_BROADCAST, [1], 4) = 0
setsockopt(6, SOL_SOCKET, SO_REUSEADDR, [1], 4) = 0
bind(6, {sa_family=AF_INET6, sin6_port=htons(9000), inet_pton(AF_INET6, "::", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, 28) = 0
listen(6, 128)                          = 0
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = 0
getsockname(6, {sa_family=AF_INET6, sin6_port=htons(9000), inet_pton(AF_INET6, "::", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, [28]) = 0
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc00045260c) = 0
close(6)                                = 0
newfstatat(AT_FDCWD, "/usr/local/etc/minio/certs/public.crt", 0xc00021df18, 0) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/etc/ssl/certs/ca-certificates.crt", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/etc/pki/tls/certs/ca-bundle.crt", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000452374) = -1 EPERM (Operation not permitted)
fstat(6, {st_mode=S_IFREG|0444, st_size=662068, ...}) = 0
mmap(NULL, 1439992, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f6559000
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
epoll_pwait(4, [{EPOLLOUT, {u32=4134264368, u64=140406615170608}}], 128, 0, NULL, 4) = 1
read(6, "# AC BOA VISTA CERTIFICADORA\n---"..., 662580) = 662068
read(6, "", 512)                        = 0
close(6)                                = 0
mmap(NULL, 65536, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f6549000
epoll_pwait(4, [{EPOLLOUT, {u32=4134264368, u64=140406615170608}}], 128, 0, NULL, 73156) = 1
epoll_pwait(4, [{EPOLLOUT, {u32=4134264368, u64=140406615170608}}], 128, 0, NULL, 1) = 1
futex(0x2612190, FUTEX_WAKE_PRIVATE, 1) = 1
mmap(NULL, 65536, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fb2f6539000
epoll_pwait(4, [{EPOLLOUT, {u32=4134264368, u64=140406615170608}}], 128, 0, NULL, 73156) = 1
openat(AT_FDCWD, "/etc/ssl/certs", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc00085431c) = -1 EPERM (Operation not permitted)
getdents64(6, /* 7 entries */, 8192)    = 240
getdents64(6, /* 0 entries */, 8192)    = 0
lstat("/etc/ssl/certs/ca-bundle.crt", {st_mode=S_IFLNK|0777, st_size=49, ...}) = 0
futex(0x2612190, FUTEX_WAKE_PRIVATE, 1) = 1
lstat("/etc/ssl/certs/ca-bundle.trust.crt", {st_mode=S_IFLNK|0777, st_size=55, ...}) = 0
lstat("/etc/ssl/certs/Makefile", {st_mode=S_IFREG|0644, st_size=2516, ...}) = 0
lstat("/etc/ssl/certs/make-dummy-cert", {st_mode=S_IFREG|0755, st_size=610, ...}) = 0
lstat("/etc/ssl/certs/renew-dummy-cert", {st_mode=S_IFREG|0755, st_size=829, ...}) = 0
close(6)                                = 0
openat(AT_FDCWD, "/etc/ssl/certs/Makefile", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000854374) = -1 EPERM (Operation not permitted)
fstat(6, {st_mode=S_IFREG|0644, st_size=2516, ...}) = 0
read(6, "UTF8 := $(shell locale -c LC_CTY"..., 3028) = 2516
read(6, "", 512)                        = 0
close(6)                                = 0
openat(AT_FDCWD, "/etc/ssl/certs/ca-bundle.crt", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000854374) = -1 EPERM (Operation not permitted)
fstat(6, {st_mode=S_IFREG|0444, st_size=662068, ...}) = 0
read(6, "# AC BOA VISTA CERTIFICADORA\n---"..., 662580) = 662068
read(6, "", 512)                        = 0
close(6)                                = 0
epoll_pwait(4, [{EPOLLOUT, {u32=4134264368, u64=140406615170608}}], 128, 0, NULL, 1) = 1
epoll_pwait(4, [{EPOLLOUT, {u32=4134264368, u64=140406615170608}}], 128, 0, NULL, 73156) = 1
futex(0x2612190, FUTEX_WAKE_PRIVATE, 1) = 1
epoll_pwait(4, [{EPOLLOUT, {u32=4134264368, u64=140406615170608}}], 128, 0, NULL, 1) = 1
openat(AT_FDCWD, "/etc/ssl/certs/ca-bundle.trust.crt", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000a10374) = -1 EPERM (Operation not permitted)
fstat(6, {st_mode=S_IFREG|0444, st_size=717687, ...}) = 0
read(6, "# AC BOA VISTA CERTIFICADORA\n---"..., 718199) = 717687
read(6, "", 512)                        = 0
close(6)                                = 0
openat(AT_FDCWD, "/etc/ssl/certs/make-dummy-cert", O_RDONLY|O_CLOEXEC) = 6
futex(0x2612190, FUTEX_WAKE_PRIVATE, 1) = 1
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000a10374) = -1 EPERM (Operation not permitted)
fstat(6, {st_mode=S_IFREG|0755, st_size=610, ...}) = 0
read(6, "#!/bin/sh\numask 077\n\nanswers() {"..., 1122) = 610
read(6, "", 512)                        = 0
close(6)                                = 0
openat(AT_FDCWD, "/etc/ssl/certs/renew-dummy-cert", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000a10374) = -1 EPERM (Operation not permitted)
fstat(6, {st_mode=S_IFREG|0755, st_size=829, ...}) = 0
read(6, "#!/bin/bash\n\nif [ $# -eq 0 ]; th"..., 1341) = 829
read(6, "", 512)                        = 0
close(6)                                = 0
openat(AT_FDCWD, "/usr/local/etc/minio/certs/CAs", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = -1 EPERM (Operation not permitted)
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000a10474) = -1 EPERM (Operation not permitted)
getdents64(6, /* 2 entries */, 262144)  = 48
getdents64(6, /* 0 entries */, 262144)  = 0
close(6)                                = 0
openat(AT_FDCWD, "/proc/sys/kernel/threads-max", O_RDONLY|O_CLOEXEC) = 6
epoll_ctl(4, EPOLL_CTL_ADD, 6, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4134264160, u64=140406615170400}}) = 0
fcntl(6, F_GETFL)                       = 0x8000 (flags O_RDONLY|O_LARGEFILE)
fcntl(6, F_SETFL, O_RDONLY|O_NONBLOCK|O_LARGEFILE) = 0
fstat(6, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
read(6, "15828\n", 512)                 = 6
read(6, "", 1530)                       = 0
epoll_ctl(4, EPOLL_CTL_DEL, 6, 0xc000a105f4) = 0
close(6)                                = 0
getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=4*1024}) = 0
setrlimit(RLIMIT_NOFILE, {rlim_cur=4*1024, rlim_max=4*1024}) = 0
getrlimit(RLIMIT_AS, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0
setrlimit(RLIMIT_AS, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0
getrlimit(RLIMIT_NOFILE, {rlim_cur=4*1024, rlim_max=4*1024}) = 0
rt_sigprocmask(SIG_SETMASK, ~[], [], 8) = 0
clone(child_stack=0xc000654000, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM) = 7985
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[HUP INT QUIT ILL TRAP ABRT BUS FPE SEGV TERM STKFLT CHLD PROF SYS RTMIN RT_1], NULL, 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[HUP INT QUIT ILL TRAP ABRT BUS FPE SEGV TERM STKFLT CHLD PROF SYS RTMIN RT_1], NULL, 8) = 0
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
rt_sigprocmask(SIG_SETMASK, ~[HUP INT QUIT ILL TRAP ABRT BUS FPE SEGV TERM STKFLT CHLD PROF SYS RTMIN RT_1], NULL, 8) = 0
futex(0xc00015d640, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x2612c60, FUTEX_WAIT_PRIVATE, 0, NULL) = 0
futex(0xc0003279c0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x2612c60, FUTEX_WAIT_PRIVATE, 0, NULL
```

## Steps to Reproduce (for bugs)

1. Create a Gluster cluster with a 3 bricks dispersed volume;
2. Mount the Gluster volume;
3. Start `minio gateway nas` using the mounted volume as data directory.

## Your Environment

* Version used (`minio version`):
  - Version: 2019-02-14T00:21:45Z
  - Release-Tag: RELEASE.2019-02-14T00-21-45Z
  - Commit-ID: a51781e5cf4a055546301ed3c49b68d7209e51d1
* Environment name and version:
  - CentOS 7.
* Operating System and version (`uname -a`):
  - Linux myhost.localdomain 3.10.0-957.5.1.el7.x86_64 #1 SMP Fri Feb 1 14:54:57 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux.

Comment 1 Otavio Cipriani 2019-02-21 18:52:25 UTC
Here is the output of `gluster --version` (latest packages from CentOS SIG, version 4.1):

glusterfs 4.1.7
Repository revision: git://git.gluster.org/glusterfs.git
Copyright (c) 2006-2016 Red Hat, Inc. <https://www.gluster.org/>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
It is licensed to you under your choice of the GNU Lesser
General Public License, version 3 or any later version (LGPLv3
or later), or the GNU General Public License, version 2 (GPLv2),
in all cases as published by the Free Software Foundation.


Here is the output of `gluster volume info` **after** applying the settings from the _virt_ group (defaults do not work, either):

Volume Name: myvolume
Type: Disperse
Volume ID: 82a71fc3-2ffa-42a3-8fe1-b439b7c3211c
Status: Started
Snapshot Count: 0
Number of Bricks: 1 x (2 + 1) = 3
Transport-type: tcp
Bricks:
Brick1: server-h01.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick2: server-h02.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick3: server-h03.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Options Reconfigured:
cluster.choose-local: off
user.cifs: off
network.remote-dio: enable
performance.low-prio-threads: 32
performance.io-cache: off
performance.read-ahead: off
performance.quick-read: off
features.shard: on
cluster.server-quorum-type: server
cluster.data-self-heal-algorithm: full
cluster.locking-scheme: granular
cluster.quorum-type: auto
cluster.eager-lock: enable
transport.address-family: inet
nfs.disable: on

The `cluster.shd*` settings were not applied, since they cannot be set for a non-replicated volumes.

I stopped/started and umounted/mounted the volume, but the problem persists.

The problem does **not** occur with a 3-way replicated volume:

Volume Name: myvolume
Type: Replicate
Volume ID: eb0c9e63-ddb2-47ef-a6a8-26ddfd31d627
Status: Started
Snapshot Count: 0
Number of Bricks: 1 x 3 = 3
Transport-type: tcp
Bricks:
Brick1: server-h01.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick2: server-h02.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick3: server-h03.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Options Reconfigured:
transport.address-family: inet
nfs.disable: on
performance.client-io-threads: off

Also does **not** occur when using a 4 + 2 dispersed volume:

Volume Name: myvolume
Type: Disperse
Volume ID: 66bc6521-6e09-4f7a-a04b-79f66e424024
Status: Started
Snapshot Count: 0
Number of Bricks: 1 x (4 + 2) = 6
Transport-type: tcp
Bricks:
Brick1: server-p01.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick2: server-p02.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick3: server-p03.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick4: server-p04.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick5: server-p05.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Brick6: server-p06.cnj.jus.br:/var/local/lib/glusterfs/brick01/brick
Options Reconfigured:
nfs.disable: on
transport.address-family: inet

Comment 2 Worker Ant 2020-03-12 12:46:33 UTC
This bug is moved to https://github.com/gluster/glusterfs/issues/945, and will be tracked there from now on. Visit GitHub issues URL for further details


Note You need to log in before you can comment on or make changes to this bug.