Initializing data within the container build #187

jldhtx · 2023-02-15T17:25:57Z

jldhtx
Feb 15, 2023

Hi! Loving the images! So helpful in creating some local test environments when dealing with a monolith oracle app.

Is it possible to modify the docker file to start the database, run initial data population scripts, then down the database and continue as usual?

My use case is to provide an image in a registry other developers can use to pull down a database initialized for our testing with static data and the correct privileges.

I've done similar things with the MSSQL on linux image by launching the main sqlservr binary, waiting for it to up, running scripts, then stopping it.

Before I dove into it, I figured I would ask people much smarter than me if they'd ever tried this approach and if I'm setting myself up for failure :)

Answered by gvenzl

Feb 20, 2023

Hey @jldhtx,

Thanks a lot for using these images!

Yeah, this is pretty straightforward, the container-entrypoint.sh has a --nowait option that will do everything it usually does, just not tail the alert.log file and hence other operations can be executed afterward.

So, for example, what you can do is:

Extend the image of your choice
Start the DB via container-entrypoint.sh --nowait
Run whatever setup you need
Shutdown the database
4.1) Compress the DB files if you are not using the *-faststart flavor
Commit the new image

For example:

FROM gvenzl/oracle-xe:21-slim-faststart

ARG ORACLE_RANDOM_PASSWORD=y

RUN container-entrypoint.sh --nowait && \
    echo "Stopping database..." && \
    e…

View full answer

gvenzl · 2023-02-20T22:54:35Z

gvenzl
Feb 20, 2023
Maintainer

Hey @jldhtx,

Thanks a lot for using these images!

Yeah, this is pretty straightforward, the container-entrypoint.sh has a --nowait option that will do everything it usually does, just not tail the alert.log file and hence other operations can be executed afterward.

So, for example, what you can do is:

Extend the image of your choice
Start the DB via container-entrypoint.sh --nowait
Run whatever setup you need
Shutdown the database
4.1) Compress the DB files if you are not using the *-faststart flavor
Commit the new image

For example:

FROM gvenzl/oracle-xe:21-slim-faststart

ARG ORACLE_RANDOM_PASSWORD=y

RUN container-entrypoint.sh --nowait && \
    echo "Stopping database..." && \
    echo "shutdown immediate;" | sqlplus -s / as sysdba && \
    lsnrctl stop

That will:

Base the new image from the 21-slim-faststart
Tell the container to use a random password for the DB
Start the container using container-entrypoint.sh --nowait
Stop the database and Listener

The nice thing about using container-entrypoint.sh is that it will do everything it normally does.
So, the starter set can, for example, be added while running container-entrypoint.sh by exposing a volume to the usual /container-entrypoint-initdb.d/ location, i.e. between 3. and 4.

Of course, you could do whatever else you need to do after 3.

When building the image (not the -v instruction), you get this:

$ buildah bud -v /home/gvenzl/tests/init:/container-entrypoint-initdb.d -t test .
STEP 1/3: FROM gvenzl/oracle-xe:21-slim-faststart
STEP 2/3: ARG ORACLE_RANDOM_PASSWORD=y
STEP 3/3: RUN container-entrypoint.sh --nowait &&     echo "Stopping database..." &&     echo "shutdown immediate;" | sqlplus -s / as sysdba &&     lsnrctl stop
CONTAINER: starting up...
CONTAINER: first database startup, initializing...
CONTAINER: starting up Oracle Database...

LSNRCTL for Linux: Version 21.0.0.0.0 - Production on 20-FEB-2023 22:43:26

Copyright (c) 1991, 2021, Oracle.  All rights reserved.

Starting /opt/oracle/product/21c/dbhomeXE/bin/tnslsnr: please wait...

TNSLSNR for Linux: Version 21.0.0.0.0 - Production
System parameter file is /opt/oracle/homes/OraDBHome21cXE/network/admin/listener.ora
Log messages written to /opt/oracle/diag/tnslsnr/d2fb995bb173/listener/alert/log.xml
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC_FOR_XE)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=0.0.0.0)(PORT=1521)))

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC_FOR_XE)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 21.0.0.0.0 - Production
Start Date                20-FEB-2023 22:43:27
Uptime                    0 days 0 hr. 0 min. 0 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Default Service           XE
Listener Parameter File   /opt/oracle/homes/OraDBHome21cXE/network/admin/listener.ora
Listener Log File         /opt/oracle/diag/tnslsnr/d2fb995bb173/listener/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC_FOR_XE)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=0.0.0.0)(PORT=1521)))
The listener supports no services
The command completed successfully
ORACLE instance started.

Total System Global Area 1241512272 bytes
Fixed Size		    9685328 bytes
Variable Size		  637534208 bytes
Database Buffers	  587202560 bytes
Redo Buffers		    7090176 bytes
Database mounted.
Database opened.

CONTAINER: Resetting SYS and SYSTEM passwords.

User altered.


User altered.

############################################
ORACLE PASSWORD FOR SYS AND SYSTEM: ZTZjNGEw
############################################

CONTAINER: Executing user defined scripts...

CONTAINER: running /container-entrypoint-initdb.d/starterset.sql ...

Session altered.


User created.


Grant succeeded.
...
...
...
CONTAINER: DONE: running /container-entrypoint-initdb.d/starterset.sql

CONTAINER: DONE: Executing user defined scripts.


#########################
DATABASE IS READY TO USE!
#########################
Stopping database...
Database closed.
Database dismounted.
ORACLE instance shut down.

LSNRCTL for Linux: Version 21.0.0.0.0 - Production on 20-FEB-2023 22:44:35

Copyright (c) 1991, 2021, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC_FOR_XE)))
The command completed successfully
COMMIT test
Getting image source signatures
Copying blob ddc0c43536ac skipped: already exists
Copying blob b43ebb3d3415 skipped: already exists
Copying blob fe89fecf60f0 skipped: already exists
Copying blob f682cf5cbc9b done
Copying config 3a76d5da79 done
Writing manifest to image destination
Storing signatures
--> 3a76d5da79b
Successfully tagged localhost/test:latest
3a76d5da79b849d2734620722949fc03c0ef395b9be8f20fec777fd37769bbd6

Then, when running a container from the new image:

$ podman run --name test -e ORACLE_RANDOM_PASSWORD=y test
CONTAINER: starting up...
CONTAINER: database already initialized.
CONTAINER: starting up Oracle Database...

LSNRCTL for Linux: Version 21.0.0.0.0 - Production on 20-FEB-2023 22:49:09

Copyright (c) 1991, 2021, Oracle.  All rights reserved.

Starting /opt/oracle/product/21c/dbhomeXE/bin/tnslsnr: please wait...

TNSLSNR for Linux: Version 21.0.0.0.0 - Production
System parameter file is /opt/oracle/homes/OraDBHome21cXE/network/admin/listener.ora
Log messages written to /opt/oracle/diag/tnslsnr/838aaaec71c7/listener/alert/log.xml
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC_FOR_XE)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=0.0.0.0)(PORT=1521)))

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=EXTPROC_FOR_XE)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 21.0.0.0.0 - Production
Start Date                20-FEB-2023 22:49:09
Uptime                    0 days 0 hr. 0 min. 0 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Default Service           XE
Listener Parameter File   /opt/oracle/homes/OraDBHome21cXE/network/admin/listener.ora
Listener Log File         /opt/oracle/diag/tnslsnr/838aaaec71c7/listener/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC_FOR_XE)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=0.0.0.0)(PORT=1521)))
The listener supports no services
The command completed successfully
ORACLE instance started.

Total System Global Area 1241512272 bytes
Fixed Size		    9685328 bytes
Variable Size		  637534208 bytes
Database Buffers	  587202560 bytes
Redo Buffers		    7090176 bytes
Database mounted.
Database opened.


#########################
DATABASE IS READY TO USE!
#########################

You happen to have the starter set data ready to go:

$ podman exec -ti test sqlplus solarsystem/solarsystem@localhost/XEPDB1

SQL*Plus: Release 21.0.0.0.0 - Production on Mon Feb 20 22:49:45 2023
Version 21.3.0.0.0

Copyright (c) 1982, 2021, Oracle.  All rights reserved.

Last Successful login time: Mon Feb 20 2023 22:49:32 +00:00

Connected to:
Oracle Database 21c Express Edition Release 21.0.0.0.0 - Production
Version 21.3.0.0.0

SQL> select name from planets;

NAME
--------------------------------------------------
Mercury
Venus
Earth
Mars
Jupiter
Saturn
Uranus
Neptune
Pluto

9 rows selected.

Hope this helps!

2 replies

jldhtx Feb 21, 2023
Author

Supremely Helpful! Thanks so much

gvenzl Feb 21, 2023
Maintainer

You are welcome! :)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Initializing data within the container build #187

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 2 replies

{{title}}

{{title}}

{{title}}

Select a reply

Initializing data within the container build #187

jldhtx Feb 15, 2023

Replies: 1 comment · 2 replies

gvenzl Feb 20, 2023 Maintainer

jldhtx Feb 21, 2023 Author

gvenzl Feb 21, 2023 Maintainer

jldhtx
Feb 15, 2023

Replies: 1 comment 2 replies

gvenzl
Feb 20, 2023
Maintainer

jldhtx Feb 21, 2023
Author

gvenzl Feb 21, 2023
Maintainer