Object storage service paths - - Alibaba Cloud Documentation Center

GanosBase allows you to import files from Alibaba Cloud Object Storage Service (OSS), MinIO, and HDFS.

File path in OSS

File path:

oss://<access_id>:<secrect_key>@[<Endpoint>]/<bucket>/path_to/file

The Endpoint parameter is optional. If you do not specify this parameter, GanosBase automatically obtains the required endpoint If you do not specify the Endpoint parameter, make sure that the path starts with a forward slash (/).

Note

The Endpoint parameter specifies the region where OSS resides. To ensure data access, make sure that the cluster and OSS are in the same region and that you use an internal endpoint for access. For more information, see OSS domain names.

File path in MinIO

File path:

mio://<id>:<key>@<host>[:<port>]/<bucket>/path_to/file

If you do not specify the port parameter, the HTTPS port is automatically used.

Note

To ensure data access and optimize data import performance, make sure that the cluster and the Minio are located in the same region and Virtual Private Cloud (VPC), and that you use an internal network address for access.

File path in Hadoop Distributed File System (HDFS)

File path:

HDFS://<user_name>@<host>:<port>/path_to/file

Take note of the following points:

If you do not specify the user_name parameter, hadoop is used as the default username.
Set host parameter to the Remote Procedure Call (RPC) endpoint and port number in the HDFS configuration file.

Note

To ensure data access and optimize data import performance, make sure that the cluster and the HDFS are located in the same region and VPC, and that you use an internal IP address for access.

Examples

OSS

OSS://my_id:my_secret@oss-cn-hangzhou-internal.aliyuncs.com/my_bucket/my_folder/my_file

MinIO

MIO://my_id:my_secret@250.0.0.1:8080/my_bucket/my_folder/my_file

HDFS

The secret parameter is not specified. In this case, the default value hadoop is used.
```
HDFS://my_id@250.0.0.1:8081/my_folder/my_file
```

The secret parameter is specified.

HDFS://my_id:my_secret@250.0.0.1:8081/my_folder/my_file