堆栈内存溢出
  简体   繁体   English

Avro 地图类型字段不支持默认值

[英]Avro Map type fields doesn't support default value

 原文  2020-01-14 05:48:32  1   1    java/ avro/ confluent-platform

问题描述

avro.version => 1.9.1 avro.version => 1.9.1

In avro schema, map type is not supporting default value.在 avro 模式中，地图类型不支持默认值。 I tried below different ways of schema.我尝试了以下不同的模式方式。

1st:第一：

{
        "name": "constrainedQuantities",
        "doc": "Map<Long, Integer>; In converter, we will map key of type String to Long type",
        "type": {
          "type": "map",
          "values": ["null","int"],
          "default": null
        }
      }

2nd:第二：

{
        "name": "constrainedQuantities",
        "doc": "Map<Long, Integer>; In converter, we will map key of type String to Long type",
        "type": {
          "type": "map",
          "values": ["null","int"]
        }
      }

3rd:第三：

{
        "name": "constrainedQuantities",
        "doc": "Map<Long, Integer>; In converter, we will map key of type String to Long type",
        "type": {
          "type": "map",
          "values": "int",
          "default": null
        }
      }

Java Code as below: Java代码如下：

I want constraintQuantities and rawQuantities to be null only.我希望constraintQuantities 和rawQuantities 只为空。 As those are optional fields.因为这些是可选字段。 Even If I don't set them as null it throws exception.即使我没有将它们设置为 null 它也会抛出异常。

AvroEdfWorkflowStatus workflowStatus = AvroEdfWorkflowStatus.newBuilder()
                .setRunUUID("2c9967ff-fd35-4c37-a597-8a6fa5360bf6")
                .setEffDate(LocalDate.of(2008, 06, 9).toString())
                .setGroupId(704801)
                .setSourceLoc(7048)
                .setPriority("P0")
                .setDestinationLoc(1554)
                .setStatus("COMPLETED")
                .setItem("9203427")
                .setConstrainedQuantities(null)
                .setRawQuantities(null)
                .build();

Above all approach generates java POJO but fails to build that object.最重要的是方法生成 java POJO 但无法构建该对象。

org.apache.avro.AvroRuntimeException: Field constrainedQuantities type:MAP pos:8 does not accept null values
    at org.apache.avro.data.RecordBuilderBase.validate(RecordBuilderBase.java:95)
    at com.example.AvroEdfWorkflowStatus$Builder.setConstrainedQuantities(AvroEdfWorkflowStatus.java:818)
    at com.codenotfound.kafka.ApiController.sendWorkflowStatusTopic(ApiController.java:113)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
    at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
    at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
    at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
    at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
    at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
    at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
    at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
    at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
    at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:635)
    at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(HttpPutFormContentFilter.java:108)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:81)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:197)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198)
    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
    at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:80)
    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
    at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:799)
    at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
    at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868)
    at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1457)
    at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
    at java.lang.Thread.run(Thread.java:748)

If don't set them null then receives below exception:如果不将它们设置为 null，则会收到以下异常：

    at org.apache.avro.generic.GenericData.getDefaultValue(GenericData.java:1151)
    at org.apache.avro.data.RecordBuilderBase.defaultValue(RecordBuilderBase.java:142)
    at com.example.AvroEdfWorkflowStatus$Builder.build(AvroEdfWorkflowStatus.java:902)
    at com.codenotfound.kafka.ApiController.sendWorkflowStatusTopic(ApiController.java:113)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
    at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
    at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
    at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
    at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
    at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
    at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
    at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
    at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
    at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:635)
    at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(HttpPutFormContentFilter.java:108)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:81)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:197)
    at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198)
    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
    at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:80)
    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
    at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:799)
    at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
    at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868)
    at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1457)
    at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
    at java.lang.Thread.run(Thread.java:748)

Can someone please help?有人可以帮忙吗？

1 个解决方案

解决方案1
 2 已采纳  2020-01-14 16:40:08

It looks like you want the constrainedQuantities to be a field in a record that you want to be optional (ie null is a valid value for that field).看起来您希望constrainedQuantities成为您希望是可选的记录中的字段（即 null 是该字段的有效值）。

If this is the case, this might be what you're looking for:如果是这种情况，这可能就是您要查找的内容：

{
  "name": "AvroEdfWorkflowStatus",
  "fields": [
    {
      "name": "constrainedQuantities",
      "type": [ "null",
        {
          "type": "map",
          "values": "int"
        }
      ],
      "default": null
    }
  ]
}

Some notes:一些注意事项：

  • In this case, the field can now contain a null value and your builder should be happy not setting it, or setting it to null, or setting it to a Map<String, Integer>在这种情况下，该字段现在可以包含一个空值，您的构建器应该很高兴不设置它，或将其设置为空，或将其设置为Map<String, Integer>
  • The default attribute is a bit tricky. default属性有点棘手。 It is unrelated to whether the field is set or unset, but used to supply a value if the field did not exist when the record was serialized.它与该字段是设置还是未设置无关，但用于在记录序列化时该字段不存在时提供一个值。
  • The default value is also unrelated to the value types in the map for missing keys. default值也与映射中缺失键的value类型无关。 In the schema above, every key must have an int value.在上面的模式中，每个键都必须有一个 int 值。 In your original schema, the value of a key could have an int or null value, which might have been your intention.在您的原始架构中，键的值可能具有 int 或 null 值，这可能是您的意图。

暂无
暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 如何在 Avro Union 逻辑类型字段中为默认值指定转换器？ - How to specify converter for default value in Avro Union logical type fields? Avro和Java：字符串的反序列化映射不“等于”原始映射 - Avro and java: deserialized map of string doesn't “equals” original map 生成的Avro Builder设置为null不会被默认覆盖 - Generated Avro Builder set null doesn't overwrite with default 默认情况下，UIL 不支持方案（协议） - UIL doesn't support scheme(protocol) by default 未应用布尔值的 avro 默认值 - avro default value for boolean not applied AVRO - 具有联合记录类型支持的复杂记录 - AVRO - Complex Records with Union Record type support Apache Avro 的 Java 中 Union 的默认值是多少？ - What is the default value for Union in Java for Apache Avro? Avro 逻辑类型“日期”，默认为空值 - Avro logicalType 'date' with default null value 服务器不支持Android 5.0的默认密码套件 - Server doesn't support Android 5.0's default cipher suite UIL默认不支持scheme（protocol）错误 - UIL doesn't support scheme(protocol) by default ERROR
相关标签
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM