Realtime Compute for Apache Flink creates directories in the Object Storage Service (OSS) bucket that is associated with your Realtime Compute for Apache Flink workspace when you purchase the workspace. The directories are used to store data files that are required for or generated during deployment running. Data files include checkpoints, savepoints, logs, and JAR packages. This topic describes how to upload resources to an OSS bucket. This topic also describes the content of each directory in the OSS bucket.
OSS Bucket
Directory description
If you set the storage type to OSS Bucket when you purchase a Realtime Compute for Apache Flink workspace, Realtime Compute for Apache Flink creates directories in the OSS bucket to store related files. The following table describes the directories.
Directory | Content |
artifacts | Stores the uploaded JAR packages, JAR dependencies, Python files, and Python dependencies. |
sql-artifacts | Stores the files on which user-defined functions (UDFs) and connectors depend. |
flink-jobs | Stores the high availability (HA) information and system checkpoint information of Realtime Compute for Apache Flink deployments. |
flink-savepoints | Stores the savepoint files that are generated after you click Create Savepoint on the Deployments page of the development console of Realtime Compute for Apache Flink. |
flink-sessionclusters | Stores the HA information and system checkpoint information of a session cluster. |
plan | Stores the resource information that you configure when the expert mode is used. |
logs | Stores the logs of a deployment that is configured to export logs to OSS. |
Resource management
Log on to the management console of Realtime Compute for Apache Flink.
Find the workspace that you want to manage and click Console in the Actions column.
In the left-side navigation pane, click Artifacts. On the page that appears, you can perform the following operations:
Upload resources: Click Upload Artifact and select an on-premises file that you want to upload. Alternatively, drag the file that you want to upload to the resource list.
After the file is uploaded, the file path is in the format of
oss://<Name of the OSS bucket that is associated with your workspace>/artifacts/namespaces/<Name of the namespace>/<File name>. You can click the file name to copy the path.Download resources: Click Download in the Actions column of a file to download the file in the OSS bucket to your on-premises machine.
Delete resources: Click Delete in the Actions column of a file to delete the file from the OSS bucket.
If you set the storage type to OSS Bucket, you can only upload, download, and delete files in the artifacts directory on the Artifacts page.
References
For more information about how to create a deployment of the SQL, JAR, or Python type, see Create a deployment.
For more information about how to view the logs of a running deployment, see View the startup logs and operational logs of a deployment.
For more information about how to view the checkpoints and savepoints of a deployment, see Status set management.