-
Notifications
You must be signed in to change notification settings - Fork 265
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
20 changed files
with
1,515 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,4 +1,4 @@ | ||
include::sections/00-welcome.md[] | ||
include::sections/java-quarkus/00-welcome.md[] | ||
|
||
--- | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,63 @@ | ||
--- | ||
short_title: Create your own ChatGPT with RAG | ||
description: Discover how to create and populate a vector database, create a Web chat interface and an API to expose your agent to the Web interface. | ||
type: workshop | ||
authors: | ||
- Yohan Lasorsa | ||
- Julien Dubois | ||
- Christopher Maneu | ||
- Sandra Ahlgrimm | ||
- Antonio Goncalves | ||
contacts: | ||
- '@sinedied' | ||
- '@juliendubois' | ||
- '@cmaneu' | ||
- '@sKriemhild' | ||
- '@agoncal' | ||
banner_url: assets/banner.jpg | ||
duration_minutes: 120 | ||
audience: students, devs | ||
level: intermediate | ||
tags: chatgpt, openai, langchain4j, retrieval-augmented-generation, azure, containers, docker, static web apps, java, quarkus, azure ai search, azure container apps | ||
published: false | ||
wt_id: javaquarkus-0000-cxa | ||
sections_title: | ||
- Welcome | ||
--- | ||
|
||
# Create your own ChatGPT with Retrieval-Augmented-Generation | ||
|
||
In this workshop, we'll explore the fundamentals of custom ChatGPT experiences based on a corpus of documents. We will create a vector database and fill-in with data from PDF documents, and then build a chat website and API to be able to ask questions about information contained in these documents. | ||
|
||
## You'll learn how to... | ||
|
||
- Create a knowledge base using a vector database. | ||
- Ingest documents in a vector database. | ||
- Create a Web API with [Quarkus](https://quarkus.io/). | ||
- Use [Azure OpenAI](https://azure.microsoft.com/products/ai-services/openai-service) models and [LangChain4j](https://langchain4j.github.io/langchain4j/) to generate answers based on a prompt. | ||
- Query a vector database and augment a prompt to generate responses. | ||
- Connect your Web API to a ChatGPT-like website. | ||
- Deploy your application on Azure. | ||
|
||
## Prerequisites | ||
|
||
| | | | ||
|----------------------------|----------------------------------------------------------------------| | ||
| GitHub account | [Get a free GitHub account](https://github.com/join) | | ||
| Azure account | [Get a free Azure account](https://azure.microsoft.com/free) | | ||
| Access to Azure OpenAI API | [Request access to Azure OpenAI](https://aka.ms/oaiapply) | | ||
| A Web browser | [Get Microsoft Edge](https://www.microsoft.com/edge) | | ||
| Java knowledge | [Java tutorial on W3schools](https://www.w3schools.com/java/) | | ||
| Quarkus knowledge | [Quarkus Getting Started](https://quarkus.io/guides/getting-started) | | ||
|
||
We'll use [GitHub Codespaces](https://github.com/features/codespaces) to have an instant dev environment already prepared for this workshop. | ||
|
||
If you prefer to work locally, we'll also provide instructions to setup a local dev environment using either VS Code with a [dev container](https://aka.ms/vscode/ext/devcontainer) or a manual install of the needed tools with your favourite IDE (Intellij IDEA, VS Code, etc.). | ||
|
||
<div class="info" data-title="note"> | ||
|
||
> Your Azure account must have `Microsoft.Authorization/roleAssignments/write` permissions, such as [Role Based Access Control Administrator](https://learn.microsoft.com/azure/role-based-access-control/built-in-roles#role-based-access-control-administrator-preview), [User Access Administrator](https://learn.microsoft.com/azure/role-based-access-control/built-in-roles#user-access-administrator), or [Owner](https://learn.microsoft.com/azure/role-based-access-control/built-in-roles#owner). Your account also needs `Microsoft.Resources/deployments/write` permissions at a subscription level to allow deployment of Azure resources. | ||
> | ||
> If you have your own personal Azure subscription, you should be good to go. If you're using an Azure subscription provided by your company, you may need to contact your IT department to ensure you have the necessary permissions. | ||
</div> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
* | ||
!target/*-runner | ||
!target/*-runner.jar | ||
!target/lib/* | ||
!target/quarkus-app/* |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,43 @@ | ||
#Maven | ||
target/ | ||
pom.xml.tag | ||
pom.xml.releaseBackup | ||
pom.xml.versionsBackup | ||
release.properties | ||
.flattened-pom.xml | ||
|
||
# Eclipse | ||
.project | ||
.classpath | ||
.settings/ | ||
bin/ | ||
|
||
# IntelliJ | ||
.idea | ||
*.ipr | ||
*.iml | ||
*.iws | ||
|
||
# NetBeans | ||
nb-configuration.xml | ||
|
||
# Visual Studio Code | ||
.vscode | ||
.factorypath | ||
|
||
# OSX | ||
.DS_Store | ||
|
||
# Vim | ||
*.swp | ||
*.swo | ||
|
||
# patch | ||
*.orig | ||
*.rej | ||
|
||
# Local environment | ||
.env | ||
|
||
# Plugin directory | ||
/.quarkus/cli/plugins/ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
maven-wrapper.jar |
98 changes: 98 additions & 0 deletions
98
src/backend-java-quarkus/.mvn/wrapper/MavenWrapperDownloader.java
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,98 @@ | ||
/* | ||
* Licensed to the Apache Software Foundation (ASF) under one | ||
* or more contributor license agreements. See the NOTICE file | ||
* distributed with this work for additional information | ||
* regarding copyright ownership. The ASF licenses this file | ||
* to you under the Apache License, Version 2.0 (the | ||
* "License"); you may not use this file except in compliance | ||
* with the License. You may obtain a copy of the License at | ||
* | ||
* http://www.apache.org/licenses/LICENSE-2.0 | ||
* | ||
* Unless required by applicable law or agreed to in writing, | ||
* software distributed under the License is distributed on an | ||
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY | ||
* KIND, either express or implied. See the License for the | ||
* specific language governing permissions and limitations | ||
* under the License. | ||
*/ | ||
|
||
import java.io.IOException; | ||
import java.io.InputStream; | ||
import java.net.Authenticator; | ||
import java.net.PasswordAuthentication; | ||
import java.net.URL; | ||
import java.nio.file.Files; | ||
import java.nio.file.Path; | ||
import java.nio.file.Paths; | ||
import java.nio.file.StandardCopyOption; | ||
|
||
public final class MavenWrapperDownloader | ||
{ | ||
private static final String WRAPPER_VERSION = "3.2.0"; | ||
|
||
private static final boolean VERBOSE = Boolean.parseBoolean( System.getenv( "MVNW_VERBOSE" ) ); | ||
|
||
public static void main( String[] args ) | ||
{ | ||
log( "Apache Maven Wrapper Downloader " + WRAPPER_VERSION ); | ||
|
||
if ( args.length != 2 ) | ||
{ | ||
System.err.println( " - ERROR wrapperUrl or wrapperJarPath parameter missing" ); | ||
System.exit( 1 ); | ||
} | ||
|
||
try | ||
{ | ||
log( " - Downloader started" ); | ||
final URL wrapperUrl = new URL( args[0] ); | ||
final String jarPath = args[1].replace( "..", "" ); // Sanitize path | ||
final Path wrapperJarPath = Paths.get( jarPath ).toAbsolutePath().normalize(); | ||
downloadFileFromURL( wrapperUrl, wrapperJarPath ); | ||
log( "Done" ); | ||
} | ||
catch ( IOException e ) | ||
{ | ||
System.err.println( "- Error downloading: " + e.getMessage() ); | ||
if ( VERBOSE ) | ||
{ | ||
e.printStackTrace(); | ||
} | ||
System.exit( 1 ); | ||
} | ||
} | ||
|
||
private static void downloadFileFromURL( URL wrapperUrl, Path wrapperJarPath ) | ||
throws IOException | ||
{ | ||
log( " - Downloading to: " + wrapperJarPath ); | ||
if ( System.getenv( "MVNW_USERNAME" ) != null && System.getenv( "MVNW_PASSWORD" ) != null ) | ||
{ | ||
final String username = System.getenv( "MVNW_USERNAME" ); | ||
final char[] password = System.getenv( "MVNW_PASSWORD" ).toCharArray(); | ||
Authenticator.setDefault( new Authenticator() | ||
{ | ||
@Override | ||
protected PasswordAuthentication getPasswordAuthentication() | ||
{ | ||
return new PasswordAuthentication( username, password ); | ||
} | ||
} ); | ||
} | ||
try ( InputStream inStream = wrapperUrl.openStream() ) | ||
{ | ||
Files.copy( inStream, wrapperJarPath, StandardCopyOption.REPLACE_EXISTING ); | ||
} | ||
log( " - Downloader complete" ); | ||
} | ||
|
||
private static void log( String msg ) | ||
{ | ||
if ( VERBOSE ) | ||
{ | ||
System.out.println( msg ); | ||
} | ||
} | ||
|
||
} |
18 changes: 18 additions & 0 deletions
18
src/backend-java-quarkus/.mvn/wrapper/maven-wrapper.properties
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,18 @@ | ||
# Licensed to the Apache Software Foundation (ASF) under one | ||
# or more contributor license agreements. See the NOTICE file | ||
# distributed with this work for additional information | ||
# regarding copyright ownership. The ASF licenses this file | ||
# to you under the Apache License, Version 2.0 (the | ||
# "License"); you may not use this file except in compliance | ||
# with the License. You may obtain a copy of the License at | ||
# | ||
# http://www.apache.org/licenses/LICENSE-2.0 | ||
# | ||
# Unless required by applicable law or agreed to in writing, | ||
# software distributed under the License is distributed on an | ||
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY | ||
# KIND, either express or implied. See the License for the | ||
# specific language governing permissions and limitations | ||
# under the License. | ||
distributionUrl=https://repo.maven.apache.org/maven2/org/apache/maven/apache-maven/3.9.6/apache-maven-3.9.6-bin.zip | ||
wrapperUrl=https://repo.maven.apache.org/maven2/org/apache/maven/wrapper/maven-wrapper/3.2.0/maven-wrapper-3.2.0.jar |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,60 @@ | ||
# java-quarkus | ||
|
||
This project uses Quarkus, the Supersonic Subatomic Java Framework. | ||
|
||
If you want to learn more about Quarkus, please visit its website: https://quarkus.io/ . | ||
|
||
## Running the application in dev mode | ||
|
||
You can run your application in dev mode that enables live coding using: | ||
```shell script | ||
./mvnw compile quarkus:dev | ||
``` | ||
|
||
> **_NOTE:_** Quarkus now ships with a Dev UI, which is available in dev mode only at http://localhost:8080/q/dev/. | ||
## Packaging and running the application | ||
|
||
The application can be packaged using: | ||
```shell script | ||
./mvnw package | ||
``` | ||
It produces the `quarkus-run.jar` file in the `target/quarkus-app/` directory. | ||
Be aware that it’s not an _über-jar_ as the dependencies are copied into the `target/quarkus-app/lib/` directory. | ||
|
||
The application is now runnable using `java -jar target/quarkus-app/quarkus-run.jar`. | ||
|
||
If you want to build an _über-jar_, execute the following command: | ||
```shell script | ||
./mvnw package -Dquarkus.package.type=uber-jar | ||
``` | ||
|
||
The application, packaged as an _über-jar_, is now runnable using `java -jar target/*-runner.jar`. | ||
|
||
## Creating a native executable | ||
|
||
You can create a native executable using: | ||
```shell script | ||
./mvnw package -Dnative | ||
``` | ||
|
||
Or, if you don't have GraalVM installed, you can run the native executable build in a container using: | ||
```shell script | ||
./mvnw package -Dnative -Dquarkus.native.container-build=true | ||
``` | ||
|
||
You can then execute your native executable with: `./target/java-quarkus-1.0.0-SNAPSHOT-runner` | ||
|
||
If you want to learn more about building native executables, please consult https://quarkus.io/guides/maven-tooling. | ||
|
||
## Related Guides | ||
|
||
- RESTEasy Reactive ([guide](https://quarkus.io/guides/resteasy-reactive)): A Jakarta REST implementation utilizing build time processing and Vert.x. This extension is not compatible with the quarkus-resteasy extension, or any of the extensions that depend on it. | ||
|
||
## Provided Code | ||
|
||
### RESTEasy Reactive | ||
|
||
Easily start your Reactive RESTful Web Services | ||
|
||
[Related guide section...](https://quarkus.io/guides/getting-started-reactive#reactive-jax-rs-resources) |
Oops, something went wrong.