InternalServerError: 500 Internal error encountered.

My code worked fine before. But, since yesterday evening, I’ve been getting the following error:


InactiveRpcError Traceback (most recent call last)
/usr/local/lib/python3.10/dist-packages/google/api_core/grpc_helpers.py in error_remapped_callable(*args, **kwargs)
71 try:
—> 72 return callable
(*args, **kwargs)
73 except grpc.RpcError as exc:

27 frames
_InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.INTERNAL
details = “Internal error encountered.”
debug_error_string = “UNKNOWN:Error received from peer ipv4:142.251.16.95:443 {created_time:“2024-01-03T07:17:07.374423547+00:00”, grpc_status:13, grpc_message:“Internal error encountered.”}”

The above exception was the direct cause of the following exception:

InternalServerError Traceback (most recent call last)
/usr/local/lib/python3.10/dist-packages/google/api_core/grpc_helpers.py in error_remapped_callable(*args, **kwargs)
72 return callable_(*args, **kwargs)
73 except grpc.RpcError as exc:
—> 74 raise exceptions.from_grpc_error(exc) from exc
75
76 return error_remapped_callable

InternalServerError: 500 Internal error encountered.

Please help me to resolve this error.

2 Likes

The error has a vague description but can you try upgrading the Python version to the latest one?

https://www.python.org/downloads/

This error comes randomly when I’m trying to hit the GEMINI Pro via API in Python. I’m using safety filters as below:

safety_settings = [
{
“category”: “HARM_CATEGORY_HARASSMENT”,
“threshold”: “BLOCK_NONE”
},
{
“category”: “HARM_CATEGORY_HATE_SPEECH”,
“threshold”: “BLOCK_NONE”
},
{
“category”: “HARM_CATEGORY_SEXUALLY_EXPLICIT”,
“threshold”: “BLOCK_NONE”
},
{
“category”: “HARM_CATEGORY_DANGEROUS_CONTENT”,
“threshold”: “BLOCK_NONE”
}
]

Still getting Errors like below:
ERROR:tornado.access:500 POST /v1beta/models/gemini-pro:generateContent?%24alt=json%3Benum-encoding%3Dint (127.0.0.1) 1017.49ms
Response is Blocked or Error Occurred: 500 POST http://localhost:42177/v1beta/models/gemini-pro:generateContent?%24alt=json%3Benum-encoding%3Dint: An internal error has occurred. Please retry or report in https://developers.generativeai.google/guide/troubleshooting

facing the same issue. my project default location is northamerica-northeast1. from the vertex ai studio UI, you can troubleshoot by selecting different location and seems working if you select location: US-Central1. wondering if this is a known issue of just me!

2 Likes

same error

raceback (most recent call last):
File “D:\CaptionThis\venv\Lib\site-packages\google\api_core\grpc_helpers.py”, line 79, in error_remapped_callable
return callable_(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\grpc_channel.py”, line 1160, in call
return _end_unary_response_blocking(state, call, False, None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\grpc_channel.py”, line 1003, in _end_unary_response_blocking
raise _InactiveRpcError(state) # pytype: disable=not-instantiable
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.INTERNAL
details = “An internal error has occurred. Please retry or report in https://developers.generativeai.google/guide/troubleshooting
debug_error_string = “UNKNOWN:Error received from peer ipv4:142.250.195.138:443 {created_time:“2024-01-18T10:34:13.3387922+00:00”, grpc_status:13, grpc_message:“An internal error has occurred. Please retry or report in https://developers.generativeai.google/guide/troubleshooting”}”

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File “D:\CaptionThis\venv\Lib\site-packages\flask\app.py”, line 1478, in call
return self.wsgi_app(environ, start_response)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\flask\app.py”, line 1458, in wsgi_app
response = self.handle_exception(e)
^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\flask\app.py”, line 1455, in wsgi_app
response = self.full_dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\flask\app.py”, line 869, in full_dispatch_request
rv = self.handle_user_exception(e)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\flask\app.py”, line 867, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\flask\app.py”, line 852, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “d:\CaptionThis\app.py”, line 51, in upload_file
captions = gc.get_caption_gemini(file_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “d:\CaptionThis\get_caption.py”, line 53, in get_caption_gemini
response = model.generate_content(prompt_parts)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\google\generativeai\generative_models.py”, line 248, in generate_content
response = self._client.generate_content(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\google\ai\generativelanguage_v1beta\services\generative_service\client.py”, line 566, in generate_content
response = rpc(
^^^^
File “D:\CaptionThis\venv\Lib\site-packages\google\api_core\gapic_v1\method.py”, line 131, in call
return wrapped_func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\google\api_core\retry.py”, line 372, in retry_wrapped_func
return retry_target(
^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\google\api_core\retry.py”, line 207, in retry_target
result = target()
^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\google\api_core\timeout.py”, line 120, in func_with_timeout
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File “D:\CaptionThis\venv\Lib\site-packages\google\api_core\grpc_helpers.py”, line 81, in error_remapped_callable
raise exceptions.from_grpc_error(exc) from exc
google.api_core.exceptions.InternalServerError: 500 An internal error has occurred. Please retry or report in https://developers.generativeai.google/guide/troubleshooting

I receive the same error with Java and region us-central1. It happens randomly. Here is the error:

com.google.api.gax.rpc.InternalException: io.grpc.StatusRuntimeException: INTERNAL: Internal error encountered.
at com.google.api.gax.rpc.ApiExceptionFactory.createException(ApiExceptionFactory.java:110)
at com.google.api.gax.rpc.ApiExceptionFactory.createException(ApiExceptionFactory.java:41)
at com.google.api.gax.grpc.GrpcApiExceptionFactory.create(GrpcApiExceptionFactory.java:86)
at com.google.api.gax.grpc.GrpcApiExceptionFactory.create(GrpcApiExceptionFactory.java:66)
at com.google.api.gax.grpc.ExceptionResponseObserver.onErrorImpl(ExceptionResponseObserver.java:82)
at com.google.api.gax.rpc.StateCheckingResponseObserver.onError(StateCheckingResponseObserver.java:84)
at com.google.api.gax.grpc.GrpcDirectStreamController$ResponseObserverAdapter.onClose(GrpcDirectStreamController.java:148)
at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
at com.google.api.gax.grpc.ChannelPool$ReleasingClientCall$1.onClose(ChannelPool.java:570)
at io.grpc.internal.DelayedClientCall$DelayedListener$3.run(DelayedClientCall.java:489)
at io.grpc.internal.DelayedClientCall$DelayedListener.delayOrExecute(DelayedClientCall.java:453)
at io.grpc.internal.DelayedClientCall$DelayedListener.onClose(DelayedClientCall.java:486)
at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:574)
at io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:72)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:742)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:723)
at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Suppressed: java.lang.RuntimeException: Asynchronous task failed
at com.google.api.gax.rpc.ServerStreamIterator.hasNext(ServerStreamIterator.java:105)
at com.google.cloud.vertexai.generativeai.preview.ResponseStreamIteratorWithHistory.hasNext(ResponseStreamIteratorWithHistory.java:37)
at com.capgemini.besti.service.GeminiProServiceImpl.sendMessageToAI(GeminiProServiceImpl.java:426)
at com.capgemini.besti.controller.ChatController.getChatResponsePayloadResponseEntity(ChatController.java:51)
at com.capgemini.besti.controller.ChatController.sendMessage(ChatController.java:45)
at com.capgemini.besti.api.ChatApi.sendMessage(ChatApi.java:68)
at jdk.internal.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:118)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:884)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:797)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1081)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:974)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1011)
at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:914)
at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:590)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:885)
at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:658)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:205)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:149)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:174)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:149)
at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:174)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:149)
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:174)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:149)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:174)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:149)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:116)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:174)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:149)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:482)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:115)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:340)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:391)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:896)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1744)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
… 1 more
Caused by: io.grpc.StatusRuntimeException: INTERNAL: Internal error encountered.
at io.grpc.Status.asRuntimeException(Status.java:537)
… 17 more

I’ve observed that transmitting a large dataset to the gemini pro API often triggers a 500 error response.

1 Like

Hello. I get the same “Internal Error 500”, intermittently using JavaScript HTTPS request. Hope this helps:

HttpErrorResponse {headers: HttpHeaders, status: 500, statusText: ‘OK’, url: 'https://generativelanguage.googleapis.com/v1beta/m…ntent?key=[MY_APIKEY], ok: false, …}
error:
error:
code: 500
message: “An internal error has occurred. Please retry or report in https://developers.generativeai.google/guide/troubleshooting
status: “INTERNAL”
[[Prototype]]: Object
[[Prototype]]: Object
headers: HttpHeaders {normalizedNames: Map(0), lazyUpdate: null, lazyInit: ƒ}
message: “Http failure response for [https://generativelanguage.googleapis.com/v1beta/models/gemini-pro:generateContent?key=[MY_APIKEY](https://generativelanguage.googleapis.com/v1beta/models/gemini-pro:generateContent?key=[MY_APIKEY)]: 500 OK”
name: “HttpErrorResponse”
ok: false
status: 500
statusText: “OK”
url: “[https://generativelanguage.googleapis.com/v1beta/models/gemini-pro:generateContent?key=[MY_APIKEY](https://generativelanguage.googleapis.com/v1beta/models/gemini-pro:generateContent?key=[MY_APIKEY)]”
[[Prototype]]: HttpResponseBase

Facing similar issue, sometime it works

2 Likes

Facing The Same Issue Randomly Getting 500

Hello. For me, the message has changed to “503” “Model is overloaded”. Which explains the intermittent failure. Hope this helps.
code: 503, message: ‘The model is overloaded. Please try again later.’, status: ‘UNAVAILABLE’

same error.

_InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.INTERNAL
	details = "Internal error encountered."
	debug_error_string = "{"created":"@1711344948.077069718","description":"Error received from peer ipv4:","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Internal error encountered.","grpc_status":13}"

InternalServerError: 500 Internal error encountered.

Same error:

_InactiveRpcError of RPC that terminated with:
status = StatusCode.INTERNAL
details = “Internal error encountered.”
debug_error_string = “UNKNOWN:Error received from peer ipv6:%5B2800:3f0:4004:809::200a%5D:443 {grpc_message:“Internal error encountered.”, grpc_status:13, created_time:“2024-04-27T16:19:23.383094-03:00”}”

Someone finds the fix?

7 Likes

Is there a fix for this issue? same input sometimes gets this error some times dont. this is a big headace and annoying. if there is not a fix, please fix it.