{"id":16687,"date":"2023-10-12T11:14:46","date_gmt":"2023-10-12T13:14:46","guid":{"rendered":"https:\/\/susiandjames.com\/?p=16687"},"modified":"2023-10-12T11:14:46","modified_gmt":"2023-10-12T13:14:46","slug":"a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines","status":"publish","type":"post","link":"https:\/\/susiandjames.com\/en\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/","title":{"rendered":"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines"},"content":{"rendered":"\n

The artificial intelligence-based digital employee SUSI<\/a> from SUSI & James<\/a> GmbH takes over and optimizes a wide variety of communication-heavy business processes in companies. SUSI ensures 24\/7 that no call goes unanswered and takes all calls. With its support, SUSI creates space and time for service-intensive issues. Employees can once again concentrate fully on value-adding activities.<\/p>\n\n\n\n

In this article, we highlight the use of SUSI as a Digital Product Advisor<\/em><\/strong>.<\/p>\n\n\n\n

We show how to combine traditional NLP<\/strong> with the power of LLMs<\/strong> and Generative AI<\/strong> in a way that ensures the best possible customer experience.<\/p>\n\n\n\n

The following demo is about a consultation between a digital employee and a user who is interested in buying a new car<\/strong>. SUSI guides the user through a three-step process in which general information about the desired vehicle can first be provided. Then, based on a suggested selection of eligible vehicles, the user can learn more about these vehicles by asking specific questions. Once the user has decided on one or more vehicles, the last step is to arrange a test drive or a purchase appointment.<\/p>\n\n\n\n

Step 0 \u2014 Preparing the data and <\/strong>make some basic considerations<\/h2>\n\n\n\n

The basis for product consulting are products, in this case about 7000 current vehicles<\/strong>, which are available in JSON format. (Displayed simplified in this example){
„name“: „A3“,
„car_model_id“: 82,
„car_trim_id“: 25295,
„car_series_id“: 2901,
„car_production_year“: „2016“,
„car_series_name“: „Sportback Schr\u00e4gheck 5-T\u00fcr“,
„car_trim_name“: „1.2 TFSI MT (105 ps)“,
„car_specifications“: {
„Anzahl der G\u00e4nge“: „6“,
„Schadstoffeinstufung“: „EURO V“,
„Fahrzeugart“: „Schr\u00e4gheck“,
„Sitzpl\u00e4tze“: „5“,
„Breite“: „1785“,
„Radstand“: „2636“,
„Spur vorne“: „1535“,
„Kofferraumvolumen minimal“: „380“,
„Kofferraumvolumen maximal“: „380“,
„Spur hinten“: „1506“,
„Kraftstoffe“: „Benzin“,
„Hubraum“: „1197“,
„Wendekreisdurchmesser“: „10.9“,
„Zuladung“: „485“,
„Anh\u00e4ngelast (gebremst)“: „3240“,
„Ladeh\u00f6he“: „677“
},
„car_options“: {
„Attraction“: [
„Elektromechanische Servolenkung mit variabler Kraft auf das lenkrad“,
„Servotronic (aktives lenkrad)“,
„Schallschutz Verglasungen“,
„Start-stop-System“,
„Mechanische Vordersitze einstellen“,
],
„Ambiente“: […],
„Ambition“: […]
},
„manufacturer“: „Audi“
}<\/p>\n\n\n\n

When developing a Retrieval or Retrieval Augmented Generation (RAG) approach for a dataset containing detailed car (or any other product) information, it\u2019s crucial to consider various factors to ensure an effective and accurate system. Here\u2019s a breakdown of the aspects to consider:<\/p>\n\n\n\n

Understanding the Data Structure<\/h2>\n\n\n\n

Understanding the dataset\u2019s structure is foundational. The given dataset is in a structured format with nested fields and especially mixed data types, which requires a clear understanding to accurately retrieve or generate the necessary information. Special consideration should be given to the fact that, depending on the heterogeneity of the data points, aspects such as the presence of contextual information,<\/em> digits<\/em>, and mixed data<\/em> must be taken into account, especially when vectorizing<\/em>.<\/p>\n\n\n\n

Indexing Strategy<\/h2>\n\n\n\n

Proper indexing is crucial for effective retrieval. Consider using a robust indexing strategy to ensure quick and accurate retrieval of car details based on various parameters such as car model, production year, or manufacturer.<\/p>\n\n\n\n

Query Formulation<\/h2>\n\n\n\n

The query formulation should be designed to handle a variety of search terms and parameters. It should be robust enough to accommodate different types of queries and return relevant results.<\/p>\n\n\n\n

Retrieval-Augmented Generation<\/h2>\n\n\n\n

For RAG, integrating retrieval mechanisms with generation models requires a seamless flow of information. Ensure that the retrieval process can feed relevant data to the generation model to facilitate meaningful output. Special attention should also be paid here to the question of the target language<\/em>, since capable LLMs do not function well multilingually in every case.<\/p>\n\n\n\n

Evaluation Metrics<\/h2>\n\n\n\n

Establishing evaluation metrics is necessary to measure the performance of the retrieval and generation systems. Metrics could include accuracy, recall, precision, and F1 score among others. To perform a qualitative analysis of the entire scope, individual metrics are usually inadequate. Frameworks like Ragas<\/a> can fill this gap.<\/p>\n\n\n\n

Scalability<\/h2>\n\n\n\n

The system should be designed to handle scalability to accommodate growing data or increased query loads without compromising performance.<\/p>\n\n\n\n

The Haystack framework<\/a> and the SmartOffice<\/a> form the basis for the above steps. In the example shown, it quickly becomes clear that an initial selection of vehicles to be proposed can and should be based on a number of metadata such as manufacturer<\/strong>, fuel consumption<\/strong> and number of seats<\/strong>.<\/p>\n\n\n\n

Since a classic document<\/em> is represented in Haystack as follows:class Document:
content: Union[str, pd.DataFrame]
content_type: Literal[„text“, „table“, „image“]
id: str
meta: Dict[str, Any]
score: Optional[float] = None
embedding: Optional[np.ndarray] = None
id_hash_keys: Optional[List[str]] = None<\/p>\n\n\n\n

the question quickly arises as to which JSON content<\/em> is defined as content<\/em> on which textual embeddings will later also be generated and which data will become part of the meta<\/em>-data.<\/p>\n\n\n\n

As for the choice of database<\/strong> (or DocumentStore<\/a>), we compared Weaviate<\/a> and ElasticSearch<\/a>. Both systems offer similar advantages and disadvantages, especially the advanced filter logic<\/a> in the case of ElasticSearch tipped the scales for prototyping.<\/p>\n\n\n\n

Step 1 \u2014 Designing Prompts for Basic Retrieval<\/h2>\n\n\n\n

In this step, the focus is on the question of how to derive and extract from almost arbitrary natural language statements the criteria on which meaningful filtering can be performed.<\/p>\n\n\n\n

\"\"\/
Step 1: General description of the car and its parameters<\/figcaption><\/figure>\n\n\n\n

The statement pictured in SUSI\u2019s introduction translates as:<\/p>\n\n\n\n

„I’d like a BMW or an Audi for a family of five with a dog.“<\/em><\/p>\n\n\n\n

The filter we need to construct from this in Haystack-compatible format looks like this:{
„$and“: {
„number_of_seats“: {
„$eq“: 5
},
„trunk_volume_minimum“: {
„$gte“: 400
},
„manufacturer“: {
„$in“: [
„BMW“,
„Audi“
]
}
}
}<\/p>\n\n\n\n

For this problem, we evaluated several approaches, including:<\/p>\n\n\n\n

Text2SQL approach<\/strong> which refers to a type of natural language processing (NLP) approach that translates natural language queries into SQL (Structured Query Language) queries.<\/p>\n\n\n\n

Span extraction approach<\/strong> which refers to a task in Natural Language Processing (NLP) where the goal is to identify and extract a specific portion of text, referred to as a \u201cspan,\u201d from a larger body of text based on a given query or condition.<\/p>\n\n\n\n

Generative approach<\/strong> which refers to the assumption that large language models given a specifying prompt have sufficient knowledge about identifying and extracting specific information from a given text to be able to satisfy the aforementioned requirement in the form of generated output.<\/p>\n\n\n\n

After a short prototyping phase of the mentioned approaches, we decided to use the generative approach<\/em>. The shortlisted models were:<\/p>\n\n\n\n

1. GPT-4<\/a>
2. Falcon-180B<\/a>
3. LeoLM-13b<\/a><\/p>\n\n\n\n

After a prompt engineering<\/em> phase, the following prompt proved to be a good fit (partially shown here):I need you to create a json serialized python dictionary as string that is derived from a user input.<\/p>\n\n\n\n

In the user input there are filter criteria that can be expressed in different ways. The user can express himself on the following parameters:<\/p>\n\n\n\n

[‚vehicle_type‘, ’seats‘, ‚width‘, ‚length‘, ‚height‘, ‚trunk_volume_minimum‘, ‚fuels‘, ‚engine_volume‘, ‚engine_power‘, ‚gasoline_grade‘, ‚transmission‘, ‚fuel_consumption_combined_at_100_km‘, ‚total_weight‘, ‚manufacturer‘, ‚vehicle_name‘].

The following logical operators are available: $and, $or<\/p>\n\n\n\n

The following comparison operators are available: $eq, $in, $gt, $gte, $lt, $lte<\/p>\n\n\n\n

The GPT-4 and Falcon-180B models have shown similar performance quality, which is why we have implemented both methods in a configurable way. The outcome looks like:<\/p>\n\n\n\n

\"\"\/
Step 1: Result with eligible cars bases on the user input<\/figcaption><\/figure>\n\n\n\n

It should be mentioned that the biggest challenge was to get the models to reliably produce structured output in JSON format. In the meantime, there are various approaches to this problem, which we have not dealt with further in the scope of this processing<\/em>. It should also be mentioned that while the LeoLM<\/strong> model did not quite provide the required result in this case, it has proven to be very capable in other experiments<\/strong>, such as extracting personal data from a text.<\/p>\n\n\n\n

Step 2 \u2014 Designing Prompts for Advanced Retrieval and Question Answering<\/h2>\n\n\n\n

In this step, the focus is on a consultation regarding the pictured vehicles (and also additional ones not pictured). The user should intuitively<\/strong> and colloquially ask questions or discuss ideas<\/strong> that will help him\/her select specific vehicles.<\/p>\n\n\n\n

\"\"\/
Step 2: Consultation regarding the pictured vehicles<\/figcaption><\/figure>\n\n\n\n

The statement pictured in SUSI\u2019s introduction translates as:<\/p>\n\n\n\n

\u201cI regularly drive long distances to work. Which of the cars do you recommend and why?\u201d<\/em><\/p>\n\n\n\n

In this statement, representative of the presented form of expected user input, there are several challenges at once<\/strong>.<\/p>\n\n\n\n

As already visible in Step 1, there is no parameter in the data basis that reads: \u201csuitable_for_long_distances\u201d.
Even if there were, the question of qualification to this suitability would arise.
The user\u2019s expectation is different: \u201cI don\u2019t know exactly what parameters need to be considered to make a vehicle suitable for long trips, so I hope (or expect) that YOU know.<\/em>\u201d<\/p>\n\n\n\n

In the second part of the statement, the user unconsciously (sometimes consciously) provides the context of the vehicles to be considered by using the term \u201cof the (mentioned) cars<\/em>\u201d.
At this point, we use the demonstrable power of the RAG procedures<\/strong>, in two ways:<\/p>\n\n\n\n

We instantiate an agent<\/strong> that handles the communication with the user. The advantage of the agent is a persistent memory<\/strong>, which is made available as a previous conversation history to the processing of the user input. Thus, the model is aware of the context when referring to information in the previous conversation by the user.<\/p>\n\n\n\n

We then give the agent various tools such as retrieving data from the Elastic Cluster and checking information on the Internet, and of course the basis of judgment: the vehicles and their data, and then try to let the model capture the relationship between the user input and the data at hand by clever prompting:Below you will find information about vehicles, such as their length, weight and equipment. Each vehicle has its own line and each line begins with the vehicle id.
The information has the scheme „attribute_descriptor: attribute_value;“ except for the options. These are under „Optionen“ and are listed as packages with the schema „_package_descriptor_: list_of_comma_separated_attributes“.
{car_description}
Under the vehicle information you will find the question of a user. Answer the question as best you can, based solely on the vehicle information. Write the answer in German. If you can’t find the answer based on the information, please let us know.
Every answer should have the format: „vehicle_id (or vehicle_ids comma separated): textual_response“, except if the user expresses an interest in buying or test driving the product, you will output „%smartoffice#vehicle_id or comma separated vehicle_ids#kind_of_interest%“ (where kind_of_interest is either test_drive or buy_vehicle) as the response.
It is possible that the user asks questions or statements with a reference to the previous course of the conversation, which you can find here:
{history}
Your answers should take this conversation history into account, if appropriate and necessary.
Question: {query}
Response:<\/p>\n\n\n\n

\"\"\/
Step 2: Response from the RAG approach<\/figcaption><\/figure>\n\n\n\n

The response in the image translates to:<\/p>\n\n\n\n

\u201cFor regular long trips to work, I recommend the Hyundai i30 station wagon with manual transmission. This car has a low combined fuel consumption of 6.7 liters per 100km, which makes it an economical option for long trips. It also has a number of helpful options for long distance driving such as steering column adjustment, folding rear seat back and ports for USB\/Aux for external devices.<\/em>\u201d<\/p>\n\n\n\n

This is exactly the behavior that we hope for or imagine from our digital employees. The response not only addresses the focus of the user\u2019s input, but also provides additional information that is considered helpful to the user.<\/p>\n\n\n\n

Again we evaluated different models:<\/p>\n\n\n\n

    \n
  1. GPT-4<\/a><\/li>\n<\/ol>\n\n\n\n

    2. Falcon-180B<\/a><\/p>\n\n\n\n

    3. LeoLM-13b<\/a><\/p>\n\n\n\n

    4. EM German Mistral<\/a><\/p>\n\n\n\n

    This time the result was more difficult to judge. While GPT-4 stood out positively in terms of \u201cconsulting performance<\/em>\u201d, the interpretation of user input in terms of \u201cparameters to be taken into account\u201d<\/em> or the direct answering of questions was clearly better in Falcon-180B from our point of view.<\/p>\n\n\n\n

    \"\"\/
    Step 2: Follow up questions to a given set of cars<\/figcaption><\/figure>\n\n\n\n

    The difficulty was, and still is, primarily in correctly capturing the task that is generated from the interpretation of the user input<\/em> and letting it flow into the prompt.<\/p>\n\n\n\n

    The question and the response in the image translate to:<\/p>\n\n\n\n

    Q: \u201cWhich of the vehicles has the largest trunk?<\/em>\u201d<\/p>\n\n\n\n

    A: \u201cThese vehicles have the largest trunk with a volume of 300 liters.<\/em>\u201d<\/p>\n\n\n\n

    Similar to the example just given, there is an implicit reference to the vehicles defined as the result set in the previous step. The character of the user\u2019s question is reminiscent of a classic example of automated question answering. The complexity of the question is much lower than the previous one because of the level of inference we expect from the model in terms of deliberative conversation.<\/p>\n\n\n\n

    Step 3 \u2014 Handing over to the SmartOffice<\/h2>\n\n\n\n

    At this step, the user has gone through the process to the point where there is either an interest in purchasing or an interest in test driving one of the vehicles.
    At this point, one could rightly think about the further use of an agent-based solution, but in the corporate context we rely on our     SmartOffice<\/em><\/a> product, as it already solves a large part of the existing challenges in a sensible and efficient way.<\/p>\n\n\n\n

    \"\"\/
    Step 3: Handover of the user to the guided dialog<\/figcaption><\/figure>\n\n\n\n

    The introduction in the image translates to:<\/p>\n\n\n\n

    \u201cHello,<\/em><\/p>\n\n\n\n

    I am SUSI, the digital employee of SUSI&james car dealership.
    I understand that this is about a test drive of the vehicles \u201c<\/em>Huyndai i40 1.6 MT (135HP)<\/em><\/strong>\u201d.
    In the following I need to ask some personal information for this.<\/em><\/p>\n\n\n\n

    Do you agree with this?<\/em>\u201d<\/p>\n\n\n\n

    The conversation then continues as follows:<\/p>\n\n\n\n

    \"\"\/
    Step 3: Continuous processing through the SmartOffice<\/figcaption><\/figure>\n\n\n\n

    SUSI in SmartOffice needs to collect various information to make an appointment for a test drive. This information is requested in the course of the conversation, and queries are asked if necessary. In this case, this is not not done by an \u201cautonomous\u201d agent, but around the NLU core of the SmartOffice, orchestrated by predefined dialogs, as shown in the following image:<\/p>\n\n\n\n

    \"\"\/
    Step 3: A dialog created with the DialogBuilder of SmartOffice<\/figcaption><\/figure>\n\n\n\n

    SmartOffice processes all the information obtained during the call and can subsequently provide it for further processing in various ways, e.g. in the form of an API call<\/strong>, a mail<\/strong> or an outgoing call<\/strong>.<\/p>\n\n\n\n

    The path shows how a consultation with predefined interest can turn into a potent lead in a sales pipeline. For reasons of comprehensibility, the procedure shown is divided into several steps. It is of course also conceivable (and we have also evaluated this) to greatly simplify this process.<\/p>\n\n\n\n

    Learnings<\/h2>\n\n\n\n

    In our view, the topic of product advice is challenging even in the very current technology space with Question Answering, Retrieval Augmented Generation, Autonomous Agents and Conversational AI.
    The main reason for this is certainly that we are not dealing with classic, general conversations with a simple question-answer process, but with complex, multi-layered dialog logic.<\/p>\n\n\n\n

    The following striking features and learnings are worth mentioning at this point:<\/p>\n\n\n\n

    Modular architecture based on LLM<\/h2>\n\n\n\n

    When designing the product consultation, we wanted to take into account that the product base may change. In one case it might be vehicles<\/em>, in the next it could be medicines<\/em> or beauty products<\/em>. For this reason, all components that are use-case specific are designed as modules<\/em> (the database, the prompts, \u2026), so that an exchange and an adaptation<\/em> are possible intuitively and with little time effort.<\/p>\n\n\n\n

    LLM vs \u201ctraditional approaches\u201d<\/h2>\n\n\n\n

    In the steps shown, it was obvious not to commit to a single technology approach<\/em>, but to decide in a fine-grained way which solution path is suitable for which problem.
    While \u201ctraditional<\/em>\u201d approaches such as entity extraction and possibly even syntax parsing promise a certain degree of security through reproducibility and control, they are relatively costly \u2014 for example, due to the use-case specific adaptations.
    Using Large Language Models<\/em>, on the other hand, works intuitively even in the first approach, and if you have either the hardware or the necessary financial resources, you will have qualitative results very quickly.
    In fact, one should not make the mistake of considering the topic of \u201cprompt engineering\u201d as \u201csolved\u201d. Even minor changes decide the value of the output and should be well considered.
    In addition, the currently popular question arises in any case whether one should finetune<\/em> an LLM in relation to the usecase or whether one should choose a RAG approach<\/em>, for example. Here, too, requirements such as a clean data basis, training resources and time quickly pose a hurdle.<\/p>\n\n\n\n

    Unpredictability of user input<\/h2>\n\n\n\n

    During the testing of the system shown and also of SmartOffice in general, we noticed that we often only think we know<\/em> what the concerns of users are and that we can only assume what inputs in system landscapes look like.
    For this reason, we follow the CDD<\/strong> (Conversation-Driven Development) approach here as well:<\/p>\n\n\n\n

    \u201cConversation-Driven Development (CDD) is the process of listening to your users and using those insights to improve your AI assistant. It is the overarching best practice approach for chatbot development. Developing great AI assistants is challenging because users will always say something you didn\u2019t anticipate. The principle behind CDD is that in every conversation users are telling you-in their own words-exactly what they want. By practicing CDD at every stage of bot development, you orient your assistant towards real user language and behavior.<\/em>\u201d<\/p>\n\n\n\n

    Through the evaluation of the system, we are certain: LLMs can play out their advantages here in particular. Due to the extensive language base, they are able to deal with unforeseen events<\/em> in a much more target-oriented way than rule-based approaches in the worst case. This case should also be controlled, but gains a certain degree of autonomy.<\/p>\n\n\n\n

    Added value of consulting services<\/h2>\n\n\n\n

    Utilizing LLM-based AI in consulting for product advisory not only enhances the quality and breadth of services but also can lead to more innovative, timely, and cost-effective solutions for clients. However, it\u2019s important to note that the human touch, ethical considerations, and deep contextual understanding that human consultants provide remain irreplaceable, and the LLMs could be seen as complementary tools rather than full replacements. Nevertheless here are a few advantages:<\/p>\n\n\n\n

    24\/7 Availability<\/strong><\/p>\n\n\n\n

    Unlike human consultants, LLMs can provide advisory services round the clock, enhancing the accessibility and convenience for clients across different time zones.<\/p>\n\n\n\n

    Scalability<\/strong><\/p>\n\n\n\n

    LLM based AI can scale to handle a larger volume of queries or a growing client base without a proportional increase in operational costs.<\/p>\n\n\n\n

    Continuous Learning<\/strong><\/p>\n\n\n\n

    With the right setup, LLMs can continuously learn from new data and feedback, improving the accuracy and relevance of the advice over time.<\/p>\n\n\n\n

    Improved Decision Support<\/strong><\/p>\n\n\n\n

    The data-driven insights generated by LLMs can provide robust decision support to clients, aiding in risk assessment and strategic planning.<\/p>\n\n\n\n

    Thank you for the attention and time invested. If you want to learn more about the use case and its uses, the demo itself or the underlying technology, get in touch anytime via mail<\/a> or LinkedIn<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

    The artificial intelligence-based digital employee SUSI from SUSI & James GmbH takes over and optimizes a wide variety of communication-heavy business processes in companies. SUSI ensures 24\/7 that no call goes unanswered and takes all calls. With its support, SUSI creates space and time for service-intensive issues. Employees can once again concentrate fully on value-adding activities. In this article, […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[20],"tags":[52,76,106,35,53,107,28,108,109,110,111,112,21],"class_list":["post-16687","post","type-post","status-publish","format-standard","hentry","category-strategische-beitraege","tag-ai","tag-artificial-intelligence","tag-generative-ai","tag-ki","tag-kuenstliche-intelligenz","tag-llm","tag-nlp","tag-product-advisor","tag-produktberater","tag-produktberaterin","tag-rag","tag-sale-pipeline","tag-susi"],"acf":[],"yoast_head":"\nA German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines - Susi & James<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/susiandjames.com\/en\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines - Susi & James\" \/>\n<meta property=\"og:description\" content=\"The artificial intelligence-based digital employee SUSI from SUSI & James GmbH takes over and optimizes a wide variety of communication-heavy business processes in companies. SUSI ensures 24\/7 that no call goes unanswered and takes all calls. With its support, SUSI creates space and time for service-intensive issues. Employees can once again concentrate fully on value-adding activities. In this article, […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/susiandjames.com\/en\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/\" \/>\n<meta property=\"og:site_name\" content=\"Susi & James\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-12T13:14:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*8d3u5H_u64tw4JVk8kMPUA.png\" \/>\n<meta name=\"author\" content=\"medina\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"medina\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"16 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/\"},\"author\":{\"name\":\"medina\",\"@id\":\"https:\\\/\\\/susiandjames.com\\\/#\\\/schema\\\/person\\\/50c85b733059f91e9917ed7ceca857fe\"},\"headline\":\"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines\",\"datePublished\":\"2023-10-12T13:14:46+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/\"},\"wordCount\":3228,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/miro.medium.com\\\/v2\\\/resize:fit:700\\\/1*8d3u5H_u64tw4JVk8kMPUA.png\",\"keywords\":[\"AI\",\"artificial Intelligence\",\"generative ai\",\"KI\",\"k\u00fcnstliche Intelligenz\",\"llm\",\"NLP\",\"product advisor\",\"produktberater\",\"produktberaterin\",\"rag\",\"sale pipeline\",\"SUSI\"],\"articleSection\":[\"Sonstige lesenswerte Beitr\u00e4ge\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/\",\"url\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/\",\"name\":\"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines - Susi & James\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/susiandjames.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/miro.medium.com\\\/v2\\\/resize:fit:700\\\/1*8d3u5H_u64tw4JVk8kMPUA.png\",\"datePublished\":\"2023-10-12T13:14:46+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/susiandjames.com\\\/#\\\/schema\\\/person\\\/50c85b733059f91e9917ed7ceca857fe\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/#primaryimage\",\"url\":\"https:\\\/\\\/miro.medium.com\\\/v2\\\/resize:fit:700\\\/1*8d3u5H_u64tw4JVk8kMPUA.png\",\"contentUrl\":\"https:\\\/\\\/miro.medium.com\\\/v2\\\/resize:fit:700\\\/1*8d3u5H_u64tw4JVk8kMPUA.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/susiandjames.com\\\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/susiandjames.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/susiandjames.com\\\/#website\",\"url\":\"https:\\\/\\\/susiandjames.com\\\/\",\"name\":\"Susi & James\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/susiandjames.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/susiandjames.com\\\/#\\\/schema\\\/person\\\/50c85b733059f91e9917ed7ceca857fe\",\"name\":\"medina\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/476a057d062d3d593514185f79bb5eb61b26b1cc87748dc372df1b849c8ddb3e?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/476a057d062d3d593514185f79bb5eb61b26b1cc87748dc372df1b849c8ddb3e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/476a057d062d3d593514185f79bb5eb61b26b1cc87748dc372df1b849c8ddb3e?s=96&d=mm&r=g\",\"caption\":\"medina\"},\"url\":\"https:\\\/\\\/susiandjames.com\\\/en\\\/author\\\/medina\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines - Susi & James","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/susiandjames.com\/en\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/","og_locale":"en_US","og_type":"article","og_title":"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines - Susi & James","og_description":"The artificial intelligence-based digital employee SUSI from SUSI & James GmbH takes over and optimizes a wide variety of communication-heavy business processes in companies. SUSI ensures 24\/7 that no call goes unanswered and takes all calls. With its support, SUSI creates space and time for service-intensive issues. Employees can once again concentrate fully on value-adding activities. In this article, […]","og_url":"https:\/\/susiandjames.com\/en\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/","og_site_name":"Susi & James","article_published_time":"2023-10-12T13:14:46+00:00","og_image":[{"url":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*8d3u5H_u64tw4JVk8kMPUA.png","type":"","width":"","height":""}],"author":"medina","twitter_card":"summary_large_image","twitter_misc":{"Written by":"medina","Est. reading time":"16 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/#article","isPartOf":{"@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/"},"author":{"name":"medina","@id":"https:\/\/susiandjames.com\/#\/schema\/person\/50c85b733059f91e9917ed7ceca857fe"},"headline":"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines","datePublished":"2023-10-12T13:14:46+00:00","mainEntityOfPage":{"@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/"},"wordCount":3228,"commentCount":0,"image":{"@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/#primaryimage"},"thumbnailUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*8d3u5H_u64tw4JVk8kMPUA.png","keywords":["AI","artificial Intelligence","generative ai","KI","k\u00fcnstliche Intelligenz","llm","NLP","product advisor","produktberater","produktberaterin","rag","sale pipeline","SUSI"],"articleSection":["Sonstige lesenswerte Beitr\u00e4ge"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/","url":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/","name":"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines - Susi & James","isPartOf":{"@id":"https:\/\/susiandjames.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/#primaryimage"},"image":{"@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/#primaryimage"},"thumbnailUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*8d3u5H_u64tw4JVk8kMPUA.png","datePublished":"2023-10-12T13:14:46+00:00","author":{"@id":"https:\/\/susiandjames.com\/#\/schema\/person\/50c85b733059f91e9917ed7ceca857fe"},"breadcrumb":{"@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/#primaryimage","url":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*8d3u5H_u64tw4JVk8kMPUA.png","contentUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*8d3u5H_u64tw4JVk8kMPUA.png"},{"@type":"BreadcrumbList","@id":"https:\/\/susiandjames.com\/a-german-rag-based-product-advisor-leveraging-the-power-of-llms-in-sales-pipelines\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/susiandjames.com\/"},{"@type":"ListItem","position":2,"name":"A German RAG based Product Advisor \u2014 Leveraging the Power of LLMs in Sales Pipelines"}]},{"@type":"WebSite","@id":"https:\/\/susiandjames.com\/#website","url":"https:\/\/susiandjames.com\/","name":"Susi & James","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/susiandjames.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/susiandjames.com\/#\/schema\/person\/50c85b733059f91e9917ed7ceca857fe","name":"Medina","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/476a057d062d3d593514185f79bb5eb61b26b1cc87748dc372df1b849c8ddb3e?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/476a057d062d3d593514185f79bb5eb61b26b1cc87748dc372df1b849c8ddb3e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/476a057d062d3d593514185f79bb5eb61b26b1cc87748dc372df1b849c8ddb3e?s=96&d=mm&r=g","caption":"medina"},"url":"https:\/\/susiandjames.com\/en\/author\/medina\/"}]}},"_links":{"self":[{"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/posts\/16687","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/comments?post=16687"}],"version-history":[{"count":0,"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/posts\/16687\/revisions"}],"wp:attachment":[{"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/media?parent=16687"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/categories?post=16687"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/susiandjames.com\/en\/wp-json\/wp\/v2\/tags?post=16687"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}