How to fix the issue where the prompt flow node is always trying to create an input image?

[l0ginp]

I write loop to generate dynamic content, but when I include inside the loop, it is always considered as new input type image.

Is there a way to fix it, or what should I do?

[brynn-code]

Hi, I just read the related part of the inputs resolving, it looks like we will regard the ![image]({{}}) as image input type, to input as plain string, maybe you could write template parameter as {{item}} and make each item started with ![image]...

[l0ginp]

If I have more than one picture, do I have to do it one by one like this? Is that correct?

![image]({{img1}})
![image]({{img2}})
![image]({{img3}})

and input will be ?

input:
    image1: ${image_data.image_1}
    image2: ${image_data.image_2}
    image3: ${image_data.image_3}

[melionel]

Hi @l0ginp , you do not have to use ![image] to make the the vision prompt to understand the image in this case if you want to pass a list of images. The ![image] can only be used to decorate single image input for now.

For your case, simple modify your prompt as:

# system:
Interpreting the images and explain the details.

# user:
here are the referenced images:

{% for item in images_data %}
    {{item}}
{% endfor %}

Then there will be an input interface named 'images_data' with type string be generated. But no worries, you can actually path list of images through this input. The only constraint is that you can not leverage UI to do this, you need to format the list of images by yourself.

Here is one example about how you can specify a list of images in flow.yaml:

For more information, you can reference this doc: https://github.com/microsoft/promptflow/blob/1be5cb88ca75ce989b49864ffa32a312f6ba9037/docs/how-to-guides/develop-a-dag-flow/process-image-in-flow.md

[l0ginp]

I tried using different types of image serialization, such as URL and Base64, but the vision prompt responded that "It's not an image" or "I don't see any image at all".

I tried several methods and found that it only understands the ![image] tag.

[melionel]

@l0ginp could you please share a sample flow for your case?

[l0ginp]

I’m currently using the following code, but I need to fix the image references one by one because it cannot loop through a list of values:

{% if image1 %}
# user:
Here is the reference image
![image]({{image1}})
{% endif %}
{% if image2 %}
![image]({{image2}})
{% endif %}
{% if image3 %}
![image]({{image3}})
{% endif %}

The issue is that this code doesn’t work for me:

{% for item in images_data %}
    ![image]{{item}}
{% endfor %}

[melionel]

@l0ginp Have you tried the prompt I suggested before ?

# system:
Interpreting the images and explain the details.

# user:
here are the referenced images:

{% for item in images_data %}
    {{item}}
{% endfor %}