Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Docker container does not run on M1 Mac #676

Open
RobinHeitz opened this issue Dec 22, 2023 · 4 comments
Open

[BUG] Docker container does not run on M1 Mac #676

RobinHeitz opened this issue Dec 22, 2023 · 4 comments
Labels
bug Something isn't working

Comments

@RobinHeitz
Copy link

Describe the bug
I cannot run the docker image on my M1 Mac. It does work under Ubuntu as expected.

Using this command from the docs:

docker run --name marqo -it --privileged -p 8882:8882 --add-host host.docker.internal:host-gateway marqoai/marqo:latest

Yields:

Docker not found. Installing it...
bash: /app/dind_setup/setup_dind.sh: No such file or directory
Preparing to start Marqo-OS...
Preparing to start Marqo-OS...
Preparing to start Marqo-OS...
rm: cannot remove '/var/run/docker.pid': No such file or directory
Preparing to start Marqo-OS...
rm: cannot remove '/var/run/docker.pid': No such file or directory
Preparing to start Marqo-OS...
rm: cannot remove '/var/run/docker.pid': No such file or directory
Preparing to start Marqo-OS...
rm: cannot remove '/var/run/docker.pid': No such file or directory
Preparing to start Marqo-OS...
rm: cannot remove '/var/run/docker.pid': No such file or directory
Preparing to start Marqo-OS...
rm: cannot remove '/var/run/docker.pid': No such file or directory
Preparing to start Marqo-OS...
rm: cannot remove '/var/run/docker.pid': No such file or directory
Preparing to start Marqo-OS...

To test my docker desktop locally, I've successfully ran hello-world and python:latest images. They worked.

To Reproduce
Steps to reproduce the behavior:

  1. run docker run --name marqo -it --privileged -p 8882:8882 --add-host host.docker.internal:host-gateway marqoai/marqo:latest on M1 Mac
  2. See error

Expected behavior
Expect it to launch, like it does on my ubuntu machines.

Desktop (please complete the following information):

  • OS: MacOS Ventura 13.2.1
  • Docker Desktop for Apple Silicon: 4.25.2

Thanks!

@RobinHeitz RobinHeitz added the bug Something isn't working label Dec 22, 2023
@tataganesh
Copy link

Did you try the instructions mentioned here - m-series-mac-users?

@RobinHeitz
Copy link
Author

RobinHeitz commented Jan 4, 2024

Well, no I did not, bc it was not mentioned in the getting started guides on the website.

However, it is not working like it should. I first started the command for launching the os.

marqo-os
Enabling execution of install_demo_configuration.sh for OpenSearch Security Plugin
**************************************************************************
** This tool will be deprecated in the next major release of OpenSearch **
** https://github.com/opensearch-project/security/issues/1755           **
**************************************************************************
OpenSearch Security Demo Installer
 ** Warning: Do not use on production or public reachable systems **
Basedir: /usr/share/opensearch
OpenSearch install type: rpm/deb on NAME="Amazon Linux"
OpenSearch config dir: /usr/share/opensearch/config
OpenSearch config file: /usr/share/opensearch/config/opensearch.yml
OpenSearch bin dir: /usr/share/opensearch/bin
OpenSearch plugins dir: /usr/share/opensearch/plugins
OpenSearch lib dir: /usr/share/opensearch/lib
Detected OpenSearch Version: x-content-2.4.0
Detected OpenSearch Security Version: 2.4.0.0

### Success
### Execute this script now on all your nodes and then start all nodes
### OpenSearch Security will be automatically initialized.
### If you like to change the runtime configuration
### change the files in ../../../config/opensearch-security and execute:
"/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.sh" -cd "/usr/share/opensearch/config/opensearch-security" -icl -key "/usr/share/opensearch/config/kirk-key.pem" -cert "/usr/share/opensearch/config/kirk.pem" -cacert "/usr/share/opensearch/config/root-ca.pem" -nhnv
### or run ./securityadmin_demo.sh
### To use the Security Plugin ConfigurationGUI
### To access your secured cluster open https://<hostname>:<HTTP port> and log in with admin/admin.
### (Ignore the SSL certificate warning because we installed self-signed demo certificates)
Enabling OpenSearch Security Plugin
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/usr/share/opensearch/lib/opensearch-2.4.0.jar)
WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
WARNING: System::setSecurityManager will be removed in a future release
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/usr/share/opensearch/lib/opensearch-2.4.0.jar)
WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
WARNING: System::setSecurityManager will be removed in a future release
[2024-01-04T19:41:57,910][INFO ][o.o.n.Node               ] [e35b5491ef83] version[2.4.0], pid[102], build[tar/744ca260b892d119be8164f48d92b8810bd7801c/2022-11-15T04:47:22.592960163Z], OS[Linux/6.4.16-linuxkit/aarch64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.5/17.0.5+8]
[2024-01-04T19:41:57,911][INFO ][o.o.n.Node               ] [e35b5491ef83] JVM home [/usr/share/opensearch/jdk], using bundled JDK [true]
[2024-01-04T19:41:57,911][INFO ][o.o.n.Node               ] [e35b5491ef83] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-5592404725611734011, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dopensearch.cgroups.hierarchy.override=/, -XX:MaxDirectMemorySize=536870912, -Dopensearch.path.home=/usr/share/opensearch, -Dopensearch.path.conf=/usr/share/opensearch/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
[2024-01-04T19:41:58,338][WARN ][stderr                   ] [e35b5491ef83] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[2024-01-04T19:41:58,338][WARN ][stderr                   ] [e35b5491ef83] SLF4J: Defaulting to no-operation (NOP) logger implementation
[2024-01-04T19:41:58,338][WARN ][stderr                   ] [e35b5491ef83] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[2024-01-04T19:41:58,343][INFO ][o.o.s.s.t.SSLConfig      ] [e35b5491ef83] SSL dual mode is disabled
[2024-01-04T19:41:58,343][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] OpenSearch Config path is /usr/share/opensearch/config
[2024-01-04T19:41:58,467][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] JVM supports TLSv1.3
[2024-01-04T19:41:58,468][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] Config directory is /usr/share/opensearch/config/, from there the key- and truststore files are resolved relatively
[2024-01-04T19:41:58,686][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] TLS Transport Client Provider : JDK
[2024-01-04T19:41:58,687][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] TLS Transport Server Provider : JDK
[2024-01-04T19:41:58,687][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] TLS HTTP Provider             : JDK
[2024-01-04T19:41:58,687][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] Enabled TLS protocols for transport layer : [TLSv1.3, TLSv1.2]
[2024-01-04T19:41:58,687][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] Enabled TLS protocols for HTTP layer      : [TLSv1.3, TLSv1.2]
[2024-01-04T19:41:58,691][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] Clustername: docker-cluster
[2024-01-04T19:41:58,695][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] Directory /usr/share/opensearch/config has insecure file permissions (should be 0700)
[2024-01-04T19:41:58,695][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/esnode-key.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,695][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/root-ca.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,696][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/esnode.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,696][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/kirk.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,696][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/kirk-key.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,938][INFO ][o.o.p.c.PluginSettings   ] [e35b5491ef83] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true, batch-metrics-retention-period-minutes: 7, rpc-port: 9650, webservice-port 9600
[2024-01-04T19:41:59,139][INFO ][o.o.i.r.ReindexPlugin    ] [e35b5491ef83] ReindexPlugin reloadSPI called
[2024-01-04T19:41:59,139][INFO ][o.o.i.r.ReindexPlugin    ] [e35b5491ef83] Unable to find any implementation for RemoteReindexExtension
[2024-01-04T19:41:59,161][INFO ][o.o.j.JobSchedulerPlugin ] [e35b5491ef83] Loaded scheduler extension: reports-scheduler, index: .opendistro-reports-definitions
[2024-01-04T19:41:59,163][INFO ][o.o.j.JobSchedulerPlugin ] [e35b5491ef83] Loaded scheduler extension: opendistro_anomaly_detector, index: .opendistro-anomaly-detector-jobs
[2024-01-04T19:41:59,163][INFO ][o.o.j.JobSchedulerPlugin ] [e35b5491ef83] Loaded scheduler extension: opendistro-index-management, index: .opendistro-ism-config
[2024-01-04T19:41:59,172][INFO ][o.o.j.JobSchedulerPlugin ] [e35b5491ef83] Loaded scheduler extension: observability, index: .opensearch-observability-job
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [aggs-matrix-stats]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [analysis-common]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [geo]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [ingest-common]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [ingest-geoip]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [ingest-user-agent]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [lang-expression]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [lang-mustache]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [lang-painless]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [mapper-extras]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [opensearch-dashboards]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [parent-join]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [percolator]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [rank-eval]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [reindex]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [repository-url]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [systemd]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded module [transport-netty4]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-alerting]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-anomaly-detection]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-asynchronous-search]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-cross-cluster-replication]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-geospatial]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-index-management]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-job-scheduler]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-knn]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-ml]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-neural-search]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-notifications]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-notifications-core]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-observability]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-performance-analyzer]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-reports-scheduler]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-security]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-security-analytics]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService     ] [e35b5491ef83] loaded plugin [opensearch-sql]
[2024-01-04T19:41:59,183][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] Disabled https compression by default to mitigate BREACH attacks. You can enable it by setting 'http.compression: true' in opensearch.yml
[2024-01-04T19:41:59,188][DEPRECATION][o.o.d.c.s.Settings       ] [e35b5491ef83] [node.max_local_storage_nodes] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2024-01-04T19:41:59,192][INFO ][o.o.e.NodeEnvironment    ] [e35b5491ef83] using [1] data paths, mounts [[/ (overlay)]], net usable_space [46.3gb], net total_space [58.3gb], types [overlay]
[2024-01-04T19:41:59,192][INFO ][o.o.e.NodeEnvironment    ] [e35b5491ef83] heap size [1gb], compressed ordinary object pointers [true]
[2024-01-04T19:41:59,207][INFO ][o.o.n.Node               ] [e35b5491ef83] node name [e35b5491ef83], node ID [3LweFOgXSV27a2say6jGbg], cluster name [docker-cluster], roles [ingest, remote_cluster_client, data, cluster_manager]
[2024-01-04T19:42:00,657][WARN ][o.o.s.c.Salt             ] [e35b5491ef83] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-01-04T19:42:00,674][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Message routing enabled: true
[2024-01-04T19:42:00,688][INFO ][o.o.s.f.SecurityFilter   ] [e35b5491ef83] <NONE> indices are made immutable.
[2024-01-04T19:42:00,865][INFO ][o.o.a.b.ADCircuitBreakerService] [e35b5491ef83] Registered memory breaker.
[2024-01-04T19:42:01,157][INFO ][o.o.m.c.b.MLCircuitBreakerService] [e35b5491ef83] Registered ML memory breaker.
[2024-01-04T19:42:01,157][INFO ][o.o.m.c.b.MLCircuitBreakerService] [e35b5491ef83] Registered ML disk breaker.
[2024-01-04T19:42:01,225][INFO ][o.r.Reflections          ] [e35b5491ef83] Reflections took 34 ms to scan 1 urls, producing 12 keys and 32 values
[2024-01-04T19:42:01,426][INFO ][o.o.t.NettyAllocator     ] [e35b5491ef83] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=1gb}]
[2024-01-04T19:42:01,481][INFO ][o.o.d.DiscoveryModule    ] [e35b5491ef83] using discovery type [single-node] and seed hosts providers [settings]
[2024-01-04T19:42:01,710][WARN ][o.o.g.DanglingIndicesState] [e35b5491ef83] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-01-04T19:42:01,904][INFO ][o.o.p.h.c.PerformanceAnalyzerConfigAction] [e35b5491ef83] PerformanceAnalyzer Enabled: false
[2024-01-04T19:42:01,919][INFO ][o.o.n.Node               ] [e35b5491ef83] initialized
[2024-01-04T19:42:01,919][INFO ][o.o.n.Node               ] [e35b5491ef83] starting ...
[2024-01-04T19:42:01,973][INFO ][o.o.t.TransportService   ] [e35b5491ef83] publish_address {172.17.0.2:9300}, bound_addresses {0.0.0.0:9300}
[2024-01-04T19:42:02,046][INFO ][o.o.c.c.Coordinator      ] [e35b5491ef83] setting initial configuration to VotingConfiguration{3LweFOgXSV27a2say6jGbg}
[2024-01-04T19:42:02,153][INFO ][o.o.c.s.MasterService    ] [e35b5491ef83] elected-as-cluster-manager ([1] nodes joined)[{e35b5491ef83}{3LweFOgXSV27a2say6jGbg}{AfiUC2e3TVCkzUQSnnJCvA}{172.17.0.2}{172.17.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_CLUSTER_MANAGER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: cluster-manager node changed {previous [], current [{e35b5491ef83}{3LweFOgXSV27a2say6jGbg}{AfiUC2e3TVCkzUQSnnJCvA}{172.17.0.2}{172.17.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}]}
[2024-01-04T19:42:02,166][INFO ][o.o.c.c.CoordinationState] [e35b5491ef83] cluster UUID set to [ZhevNRdGSO61W07y-GMbjw]
[2024-01-04T19:42:02,176][INFO ][o.o.c.s.ClusterApplierService] [e35b5491ef83] cluster-manager node changed {previous [], current [{e35b5491ef83}{3LweFOgXSV27a2say6jGbg}{AfiUC2e3TVCkzUQSnnJCvA}{172.17.0.2}{172.17.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}]}, term: 1, version: 1, reason: Publication{term=1, version=1}
[2024-01-04T19:42:02,179][INFO ][o.o.a.c.ADClusterEventListener] [e35b5491ef83] Cluster is not recovered yet.
[2024-01-04T19:42:02,181][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,190][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Cache cluster manager node onClusterManager time: 1704397322190
[2024-01-04T19:42:02,194][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [e35b5491ef83] Config override setting update called with empty string. Ignoring.
[2024-01-04T19:42:02,197][INFO ][o.o.d.PeerFinder         ] [e35b5491ef83] setting findPeersInterval to [1s] as node commission status = [true] for local node [{e35b5491ef83}{3LweFOgXSV27a2say6jGbg}{AfiUC2e3TVCkzUQSnnJCvA}{172.17.0.2}{172.17.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}]
[2024-01-04T19:42:02,199][INFO ][o.o.h.AbstractHttpServerTransport] [e35b5491ef83] publish_address {172.17.0.2:9200}, bound_addresses {0.0.0.0:9200}
[2024-01-04T19:42:02,199][INFO ][o.o.n.Node               ] [e35b5491ef83] started
[2024-01-04T19:42:02,200][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] Node started
[2024-01-04T19:42:02,200][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Will attempt to create index .opendistro_security and default configs if they are absent
[2024-01-04T19:42:02,200][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] 0 OpenSearch Security modules loaded so far: []
[2024-01-04T19:42:02,200][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Background init thread started. Install default config?: true
[2024-01-04T19:42:02,205][INFO ][o.o.a.c.HashRing         ] [e35b5491ef83] Node added: [3LweFOgXSV27a2say6jGbg]
[2024-01-04T19:42:02,206][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,207][INFO ][o.o.a.c.HashRing         ] [e35b5491ef83] Add data node to AD version hash ring: 3LweFOgXSV27a2say6jGbg
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.HashRing         ] [e35b5491ef83] All nodes with known AD version: {3LweFOgXSV27a2say6jGbg=ADNodeInfo{version=2.4.0, isEligibleDataNode=true}}
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.HashRing         ] [e35b5491ef83] Rebuild AD hash ring for realtime AD with cooldown, nodeChangeEvents size 0
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.HashRing         ] [e35b5491ef83] Build AD version hash ring successfully
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.ADDataMigrator   ] [e35b5491ef83] Start migrating AD data
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.ADDataMigrator   ] [e35b5491ef83] AD job index doesn't exist, no need to migrate
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.ADClusterEventListener] [e35b5491ef83] Init AD version hash ring successfully
[2024-01-04T19:42:02,218][INFO ][o.o.g.GatewayService     ] [e35b5491ef83] recovered [0] indices into cluster_state
[2024-01-04T19:42:02,262][INFO ][o.o.c.m.MetadataCreateIndexService] [e35b5491ef83] [.opendistro_security] creating index, cause [api], templates [], shards [1]/[1]
[2024-01-04T19:42:02,267][INFO ][o.o.c.r.a.AllocationService] [e35b5491ef83] updating number_of_replicas to [0] for indices [.opendistro_security]
[2024-01-04T19:42:02,307][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,443][INFO ][o.o.c.r.a.AllocationService] [e35b5491ef83] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.opendistro_security][0]]]).
[2024-01-04T19:42:02,466][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,467][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Index .opendistro_security created?: true
[2024-01-04T19:42:02,467][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Node started, try to initialize it. Wait for at least yellow cluster state....
[2024-01-04T19:42:02,472][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'config' with /usr/share/opensearch/config/opensearch-security/config.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,527][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] create_mapping
[2024-01-04T19:42:02,538][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,574][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'config' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,574][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'roles' with /usr/share/opensearch/config/opensearch-security/roles.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,583][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,594][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,606][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'roles' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,606][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'rolesmapping' with /usr/share/opensearch/config/opensearch-security/roles_mapping.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,614][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,624][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,631][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'rolesmapping' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,631][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'internalusers' with /usr/share/opensearch/config/opensearch-security/internal_users.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,639][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,652][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,665][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'internalusers' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,665][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'actiongroups' with /usr/share/opensearch/config/opensearch-security/action_groups.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,680][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,694][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,705][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'actiongroups' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,705][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'tenants' with /usr/share/opensearch/config/opensearch-security/tenants.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,712][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,724][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,731][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'tenants' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,731][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'nodesdn' with /usr/share/opensearch/config/opensearch-security/nodes_dn.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2024-01-04T19:42:02,737][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,747][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,755][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'nodesdn' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,755][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'whitelist' with /usr/share/opensearch/config/opensearch-security/whitelist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2024-01-04T19:42:02,761][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,771][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,777][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'whitelist' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,777][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'allowlist' with /usr/share/opensearch/config/opensearch-security/allowlist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2024-01-04T19:42:02,783][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,793][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,800][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'allowlist' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,800][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Will update 'audit' with /usr/share/opensearch/config/opensearch-security/audit.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,813][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,824][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,830][INFO ][o.o.s.s.ConfigHelper     ] [e35b5491ef83] Doc with id 'audit' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,914][INFO ][stdout                   ] [e35b5491ef83] [FINE] No subscribers registered for event class org.opensearch.security.securityconf.DynamicConfigFactory$NodesDnModelImpl
[2024-01-04T19:42:02,914][INFO ][stdout                   ] [e35b5491ef83] [FINE] No subscribers registered for event class org.greenrobot.eventbus.NoSubscriberEvent
[2024-01-04T19:42:02,914][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing on REST API is enabled.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from REST API auditing.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing on Transport API is enabled.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from Transport API auditing.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing of request body is enabled.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Bulk requests resolution is disabled during request auditing.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Index resolution is enabled during request auditing.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Sensitive headers auditing is enabled.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing requests from kibanaserver users is disabled.
[2024-01-04T19:42:02,916][WARN ][o.o.s.a.r.AuditMessageRouter] [e35b5491ef83] No endpoint configured for categories [BAD_HEADERS, FAILED_LOGIN, MISSING_PRIVILEGES, GRANTED_PRIVILEGES, OPENDISTRO_SECURITY_INDEX_ATTEMPT, SSL_EXCEPTION, AUTHENTICATED, INDEX_EVENT, COMPLIANCE_DOC_READ, COMPLIANCE_DOC_WRITE, COMPLIANCE_EXTERNAL_CONFIG, COMPLIANCE_INTERNAL_CONFIG_READ, COMPLIANCE_INTERNAL_CONFIG_WRITE], using default endpoint
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing of external configuration is disabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing of internal configuration is enabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing only metadata information for read request is enabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing will watch {} for read requests.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing read operation requests from kibanaserver users is disabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing only metadata information for write request is enabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing diffs for write requests is disabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing write operation requests from kibanaserver users is disabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Auditing will watch <NONE> for write requests.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] .opendistro_security is used as internal security index.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Internal index used for posting audit logs is null
[2024-01-04T19:42:02,917][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Hot-reloading of audit configuration is enabled
[2024-01-04T19:42:02,917][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Node 'e35b5491ef83' initialized
[2024-01-04T19:43:02,209][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Performing ISM template migration.
[2024-01-04T19:43:02,218][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Doing ISM template migration 1 time.
[2024-01-04T19:43:02,220][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Use 2024-01-04T18:42:02.190Z as migrating ISM template last_updated_time
[2024-01-04T19:43:02,231][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] ISM templates: {}
[2024-01-04T19:43:02,232][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Policies to update: []
[2024-01-04T19:43:02,239][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Performing move cluster state metadata.
[2024-01-04T19:43:02,242][INFO ][o.o.i.i.MetadataService  ] [e35b5491ef83] ISM config index not exist, so we cancel the metadata migration job.
[2024-01-04T19:43:02,264][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Failure experienced when migrating ISM Template and update ISM policies: {}
[2024-01-04T19:43:02,301][INFO ][o.o.c.s.ClusterSettings  ] [e35b5491ef83] updating [plugins.index_state_management.template_migration.control] from [0] to [-1]
[2024-01-04T19:43:02,302][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:43:02,305][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Successfully update template migration setting
[2024-01-04T19:44:02,245][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Cancel background move metadata process.
[2024-01-04T19:44:02,255][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Performing move cluster state metadata.
[2024-01-04T19:44:02,255][INFO ][o.o.i.i.MetadataService  ] [e35b5491ef83] Move metadata has finished.
[2024-01-04T19:44:25,843][DEPRECATION][o.o.d.c.m.IndexNameExpressionResolver] [e35b5491ef83] this request accesses system indices: [.opendistro_security], but in a future major version, direct access to system indices will be prevented by default
[2024-01-04T19:44:25,866][INFO ][o.o.c.m.MetadataCreateIndexService] [e35b5491ef83] [security-auditlog-2024.01.04] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[2024-01-04T19:44:25,904][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:44:25,937][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:44:25,954][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [security-auditlog-2024.01.04/exXVsEpaRNiq97mAv5HfLg] create_mapping
[2024-01-04T19:44:25,965][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
^CKilling opensearch process 102
[2024-01-04T19:46:40,561][INFO ][o.o.n.Node               ] [e35b5491ef83] stopping ...
[2024-01-04T19:46:40,561][INFO ][o.o.s.a.r.AuditMessageRouter] [e35b5491ef83] Closing AuditMessageRouter
[2024-01-04T19:46:40,571][INFO ][o.o.s.a.s.SinkProvider   ] [e35b5491ef83] Closing InternalOpenSearchSink
[2024-01-04T19:46:40,572][INFO ][o.o.s.a.s.SinkProvider   ] [e35b5491ef83] Closing DebugSink
[2024-01-04T19:46:40,705][INFO ][o.o.n.Node               ] [e35b5491ef83] stopped
[2024-01-04T19:46:40,705][INFO ][o.o.n.Node               ] [e35b5491ef83] closing ...
[2024-01-04T19:46:40,731][INFO ][o.o.s.a.i.AuditLogImpl   ] [e35b5491ef83] Closing AuditLogImpl
[2024-01-04T19:46:40,741][INFO ][o.o.n.Node               ] [e35b5491ef83] closed
Killing performance analyzer process 103
OpenSearch exited with code 130
Performance analyzer exited with code 143

After 2 minutes then the second container but it terminates:

marqo
Found Marqo-OS URL. Skipping internal Marqo-OS configuration.
Starting Marqo throttling...
Marqo throttling successfully started.
/usr/local/lib/python3.8/dist-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension:
  warn(f"Failed to load image Python extension: {e}")
INFO:ModelsForStartup:pre-loading ['hf/all_datasets_v4_MiniLM-L6', 'ViT-L/14'] onto devices=['cpu']
INFO:DeviceSummary:found devices [{'id': -1, 'name': ['cpu']}]
INFO:SetBestAvailableDevice:Best available device set to: cpu
config.json:   0%|          | 0.00/612 [00:00<?, ?B/s]

###########################################################
###########################################################
###### STARTING DOWNLOAD OF MARQO ARTEFACTS################
###########################################################
###########################################################


loading for: model_name=hf/all_datasets_v4_MiniLM-L6 and properties={'name': 'flax-sentence-embeddings/all_datasets_v4_MiniLM-L6', 'dimensions': 384, 'tokens': 128, 'type': 'hf', 'notes': ''}
config.json: 100%|██████████| 612/612 [00:00<00:00, 84.8kB/s]
pytorch_model.bin: 100%|██████████| 90.9M/90.9M [00:07<00:00, 12.9MB/s]
tokenizer_config.json: 100%|██████████| 535/535 [00:00<00:00, 268kB/s]
vocab.txt: 100%|██████████| 232k/232k [00:00<00:00, 1.20MB/s]
tokenizer.json: 100%|██████████| 466k/466k [00:00<00:00, 4.08MB/s]
special_tokens_map.json: 100%|██████████| 112/112 [00:00<00:00, 151kB/s]
INFO:marqo.s2_inference.s2_inference:loaded hf/all_datasets_v4_MiniLM-L6 on device cpu with normalization=True at time=2024-01-04 19:44:25.862665.
INFO:ModelsForStartup:hf/all_datasets_v4_MiniLM-L6 cpu run succesfully!
loading for: model_name=ViT-L/14 and properties={'name': 'ViT-L/14', 'dimensions': 768, 'notes': 'CLIP ViT-L/14', 'type': 'clip'}
100%|███████████████████████████████████████| 890M/890M [01:12<00:00, 12.9MiB/s]./run_marqo.sh: line 161:    19 Killed                  uvicorn api:app --host 0.0.0.0 --port 8882 --timeout-keep-alive 75 --log-level $MARQO_LOG_LEVEL

It should be the webserver for the db right?
Thanks :)

@AlbertoLanaro
Copy link

Same problem here, with version 2.1.0. Cannot run docker container on Mac M1 (Sonoma 14.0).

After successfully pulling the image, if I run the command:

$  docker run --name marqo -it -p 8882:8882 marqoai/marqo:2.1.0

I got this error:

External vector store not configured. Using local vector store
Waiting for vector store to start
Warning: Failed to configure local vector store. Marqo may not function correctly
Starting Marqo throttling
Called Marqo throttling start command
Marqo throttling is now running
/usr/local/lib64/python3.8/site-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension:
  warn(f"Failed to load image Python extension: {e}")
/usr/local/lib/python3.8/site-packages/transformers/generation_utils.py:24: FutureWarning: Importing `GenerationMixin` from `src/transformers/generation_utils.py` is deprecated and will be removed in Transformers v5. Import as `from transformers import GenerationMixin` instead.
  warnings.warn(
INFO:ModelsForStartup:pre-loading ['hf/e5-base-v2', 'open_clip/ViT-B-32/laion2b_s34b_b79k'] onto devices=['cpu']
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
    yield
  File "/usr/local/lib/python3.8/site-packages/httpcore/_backends/sync.py", line 212, in connect_tcp
    sock = socket.create_connection(
  File "/usr/lib64/python3.8/socket.py", line 808, in create_connection
    raise err
  File "/usr/lib64/python3.8/socket.py", line 796, in create_connection
    sock.connect(sa)
OSError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
    yield
  File "/usr/local/lib/python3.8/site-packages/httpx/_transports/default.py", line 228, in handle_request
    resp = self._pool.handle_request(req)
  File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request
    raise exc
  File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request
    response = connection.handle_request(request)
  File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection.py", line 99, in handle_request
    raise exc
  File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection.py", line 76, in handle_request
    stream = self._connect(request)
  File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection.py", line 124, in _connect
    stream = self._network_backend.connect_tcp(**kwargs)
  File "/usr/local/lib/python3.8/site-packages/httpcore/_backends/sync.py", line 219, in connect_tcp
    sock.setsockopt(socket.IPPROTO_TCP, socket.TCP_NODELAY, 1)
  File "/usr/lib64/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/usr/local/lib/python3.8/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
    raise to_exc(exc) from exc
httpcore.ConnectError: [Errno 99] Cannot assign requested address

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/bin/uvicorn", line 8, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/uvicorn/main.py", line 416, in main
    run(
  File "/usr/local/lib/python3.8/site-packages/uvicorn/main.py", line 587, in run
    server.run()
  File "/usr/local/lib/python3.8/site-packages/uvicorn/server.py", line 61, in run
    return asyncio.run(self.serve(sockets=sockets))
  File "/usr/lib64/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
  File "/usr/local/lib/python3.8/site-packages/uvicorn/server.py", line 68, in serve
    config.load()
  File "/usr/local/lib/python3.8/site-packages/uvicorn/config.py", line 467, in load
    self.loaded_app = import_from_string(self.app)
  File "/usr/local/lib/python3.8/site-packages/uvicorn/importer.py", line 21, in import_from_string
    module = importlib.import_module(module_str)
  File "/usr/lib64/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 843, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/app/src/marqo/tensor_search/api.py", line 50, in <module>
    on_start(_config)
  File "/app/src/marqo/tensor_search/on_start_script.py", line 36, in on_start
    thing_to_start.run()
  File "/app/src/marqo/tensor_search/on_start_script.py", line 48, in run
    created = self.config.index_management.bootstrap_vespa()
  File "/app/src/marqo/core/index_management/index_management.py", line 64, in bootstrap_vespa
    app = self.vespa_client.download_application()
  File "/app/src/marqo/vespa/vespa_client.py", line 103, in download_application
    session_id = self._create_deploy_session(httpx_client)
  File "/app/src/marqo/vespa/vespa_client.py", line 473, in _create_deploy_session
    response = httpx_client.post(endpoint)
  File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 1132, in post
    return self.request(
  File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 814, in request
    return self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 901, in send
    response = self._send_handling_auth(
  File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 929, in _send_handling_auth
    response = self._send_handling_redirects(
  File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 966, in _send_handling_redirects
    response = self._send_single_request(request)
  File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 1002, in _send_single_request
    response = transport.handle_request(request)
  File "/usr/local/lib/python3.8/site-packages/httpx/_transports/default.py", line 228, in handle_request
    resp = self._pool.handle_request(req)
  File "/usr/lib64/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/usr/local/lib/python3.8/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ConnectError: [Errno 99] Cannot assign requested address

@suprateembanerjee
Copy link

Same issue. Where are the instructions for M series macs?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants