I am trying to build a queue so that when I pull messages off the service bus, I can let them build up until I have a thousand before I send them to my database. I looked at ReceiveBatch but it only lets me grab up to 256 at most and the number that comes back is random. This forces me to make multiple calls and hope that I get around 1000. I need this batching for DB performance reasons.

I gave up on ReceiveBatch and tried to use OnMessage() instead to avoid incurring extra charges for multiple receivebatch calls and to get a more accurate batch size.

I've tried to create various client-side queue types ConcurrentQueue, ConcurrentBag, BlockingCollection to temporarily hold my OnMessage(m) received messages but no matter what I use the BrokerMessage is disposed when I try to access it outside of the OnMessage thread. I even tried creating a class level variable to keep a reference to it. I am pretty positive that OnMessage is auto disposing the message. I can't call the complete inside of OnMessage, so how am I supposed to work with the message. I need to stop it from auto-disposing.

var batchingQueue = new ConcurrentBag<BrokeredMessage>();
myQueueClient.OnMessage((m) =>
{
    Console.WriteLine("Queueing message");
    batchingQueue.Add(m);
});

while (true)
{
    BrokeredMessage msg;
    while (batchingQueue.TryTake(out msg))
    {
        ...do this until I have a thousand ready to be written to DB in batch
        Console.WriteLine("Completing message");
        msg.Complete(); // <== BROKER MESSAGE DISPOSED ERROR HERE
    }
}

Hi,

The documentation on how to setup Service Bus with Always On Availability Groups is rather sparse.

The documentation I have found explains the setup with very few lines:

"Using the cmdlets, pass the necessary connection string to New-SBFarm, Add-SBHost, and New-SBMessageContainer."

Source: https://msdn.microsoft.com/en-us/library/jj712784.aspx#BMK_SBConfig17

My assumptions of what needs to be performed are:

1. Create an installation
2. Then stop the service bus nodes
3. Create an availability group of the databases
4. Change Service Bus connection string to use the availability group listener according to the steps here: https://msdn.microsoft.com/en-us/library/jj712784.aspx#BMK_SBConfig6

Is there any more complete documentation about this and/or are my assumptions correct?

Regards,

//Thomas

Hi

We have a scenario where a message fails multiple times for a particular subscriber and is sent to the deadletter queue. Particular deadletter messages we want to resubmit to the particular subscriber at a later time.

I cannot see a way to do this. I try to resubmit to the subscriber's queue doing something like the following:

var subscriptionPath = SubscriptionClient.FormatSubscriptionPath(topicName, subscriptionName);
var client = QueueClient.CreateFromConnectionString(connectionString, subscriptionPath);
client.Send(brokeredMessage);

But this causes an Invalid Operation exception with message Cannot open a Queue client for entity type Subscriber.

I'm able to resubmit it to the topic, but that means all subscribers receive it, so I don't want to do this.

How do I do this? If I'm not able to, what is recommended instead?

Thanks

I'm using the QueueClient from the NuGet package Microsoft Azure Service Bus 2.5.2. When I go to the definition for that class I see the following:

public abstract class QueueClient : MessageClientEntity, IMessageSessionEntity, IMessageClientEntity, IMessageSender, IMessageReceiver, IMessageBrowser

The problem I'm having is that none of the interfaces show as known types. I cannot examine the metadata for any of them. Can someone tell me why metadata for these interfaces would be missing inside VS2013 Update 4 and where I might find documentation for them? I'm having no luck finding them myself.

HI Team,

Is there any way to Delete or clean all messages from Event Hub

I just discovered that I can't communicate with the Microsoft Service Bus (Not Azure SB) on another machine without install certificates. (Right?) So I see there are management API to get topics, etc. Need to confirm that I can use this with the Microsoft Service Bus (Not Azure SB). Any examples?

Thanks

Ralph

Hi,

I am developing a iOS application.. In this, i need to access a Windows azure service queue...How could we do this? Can anyone give a solution with sample?

We are trying to evaluate the Event Hub service but having trouble using it. Weather we are trying to send to the Event Hub or read from the Event Hub we get the same exception:

System.NotSupportedException was caught
  HResult=-2146233067
  Message=The requested protocol version 'AMQP 3 1.0.0' is not supported. The supported version is 'AMQP 0 1.0.0'.
  Source=Microsoft.ServiceBus

The code used in this example is:

using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using System.Threading.Tasks;

using System.Threading;
using Microsoft.ServiceBus.Messaging;

namespace SB_Test
{
    class Program
    {
        static string eventHubName = "{name of the event hub used goes here}";
        static string connectionString = "{our Connection string goes here";

        static void SendingRandomMessages()
        {
            var eventHubClient = EventHubClient.CreateFromConnectionString(connectionString, eventHubName);
            while (true)
            {
                try
                {
                    var message = Guid.NewGuid().ToString();
                    Console.WriteLine("{0} > Sending message: {1}", DateTime.Now, message);
                    eventHubClient.Send(new EventData(Encoding.UTF8.GetBytes(message)));
                }
                catch (Exception exception)
                {
                    Console.ForegroundColor = ConsoleColor.Red;
                    Console.WriteLine("{0} > Exception: {1}", DateTime.Now, exception.Message);
                    Console.ResetColor();
                }

                Thread.Sleep(200);
            }
        }

        static void Main(string[] args)
        {
            Console.WriteLine("Press Ctrl-C to stop the sender process");
            Console.WriteLine("Press Enter to start now");
            Console.ReadLine();
            SendingRandomMessages();
        }
    }
}

(This code is picked up from Get started with Event Hubs )

We have tryed with and without appending

;TransportType=Amqp

to the Connections string but the result is the same.

This exception started to show up just 2-3 Days ago. Before it was possible to send messages to the Event Hub without the exception.

Thanks in advance for any input on this that can help us to resolve the issue.

Kind Regards

 - Stefan

Having a pretty terrible time here. Any help would be greatly appreciated.

First of all I have tried completely uninstalling all Azure/Fabric/Service Bus type SDKs and installations. I have installed both Windows Azure Pack: Service Bus 1.1 and Windows Azure Pack: Security Update for Service Bus 1.1 (KB2972621) from scratch.

After deleting all service bus related databases I start the Service Bus Configuration wizard and begin starting a new farm with custom settings.

I leave everything default except adding my own certificates, and of course entering my password.

After clicking go the the service bus configuration wizard eventually gets stuck in progress:

Starting
Created and configured Service Bus farm management database.
Created and configured Service Bus gateway database.
Creating default container.

Processing completed
Validating input and configuration parameters.
Granting 'Log on as Service' privilege to the run as account.
Windows Fabric configuration started.
Running Windows Fabric deployment.
Windows Fabric starting.
Service Bus configuration started.
Updating database.
Service Bus services starting.

The event viewer logs for Microsoft-Service Bus > Operational has the following errors. Top error received first...

Exception during fabric service creation for container 1, Exception System.ArgumentException: At least one address must be provided if hostEndpoints is non-null
Parameter name: hostEndpoints
   at System.Fabric.FabricClient.InitializeFabricClient(SecurityCredentials credential, TimeSpan keepAliveInterval, String[] hostEndpoints)
   at System.Fabric.FabricClient..ctor(SecurityCredentials credential, String[] hostEndpoints)
   at Microsoft.ServiceBus.Commands.ServiceBusGetCommands.CreateFabricClient()
   at Microsoft.ServiceBus.Commands.ServiceBusCommandBase.RegisterWinFabricService(Int64 containerId)

And then:

Service Bus Gateway service failed to start, retry count 1.  Exception message: An error occurred creating the configuration section handler for namespacePolicyDataStoreFactory: Could not load file or assembly 'Microsoft.Cloud.Common.AzureStorage, Version=2.1.0.0, Culture=neutral, PublicKeyToken=4fe77f22fa8374f3' or one of its dependencies. The system cannot find the file specified..  Stack Trace:    at System.Configuration.BaseConfigurationRecord.CallCreateSection(Boolean inputIsTrusted, FactoryRecord factoryRecord, SectionRecord sectionRecord, Object parentConfig, ConfigXmlReader reader, String filename, Int32 line)
   at System.Configuration.BaseConfigurationRecord.CreateSectionDefault(String configKey, Boolean getRuntimeObject, FactoryRecord factoryRecord, SectionRecord sectionRecord, Object& result, Object& resultRuntimeObject)
   at System.Configuration.BaseConfigurationRecord.GetSectionRecursive(String configKey, Boolean getLkg, Boolean checkPermission, Boolean getRuntimeObject, Boolean requestIsHere, Object& result, Object& resultRuntimeObject)
   at Microsoft.Cloud.ServiceBus.ServiceRegistryManagerContext.CreateNamespacePolicyDataManager(IComponentSite site)
   at Microsoft.Cloud.ServiceBus.ServiceRegistryManagerContext.LoadServices(IComponentSite site)
   at Microsoft.Cloud.ServiceBus.Common.Components.ComponentFactoryBase`1.CreateComponent()
   at Microsoft.Cloud.HostingModel.ComponentHost.CreateComponent(IComponentFactory componentFactory)
   at Microsoft.Cloud.HostingModel.ComponentHost.CreateComponents()
   at Microsoft.Cloud.HostingModel.ComponentHost.Open()
   at Microsoft.ServiceBus.Gateway.Gateway.OnStart(String[] args)

In Services the relevant services have the following statuses:

• Service Bus Gateway: Starting
• Service Bus Message Broker: Stopped
• Service Bus Resource Provider: Stopped

Thanks

Hi,

I'm trying to get Service Bus Topics and/or Queues working on Linux with the open source Mono framework. I created 2 test console apps (sender/receiver) which work perfectly on my Windows machine. But if I try to run them on Linux, I get the following exception:

Unhandled Exception:
System.TypeInitializationException: An exception was thrown by the type initializer for TimerManager ---> System.EntryPointNotFoundException: CreateWaitableTimer  at (wrapper managed-to-native) Microsoft.ServiceBus.Common.Interop.UnsafeNativeMethods:CreateWaitableTimer (intptr,bool,string)

It seems CreateWaitableTimer is not available on Linux. Is there a way to use the Service Bus SDK without relying on CreateWaitableTimer? Or is there another SDK/Nuget package I can use?

Thanks!

J

I have many topics, each with a single subscription that is set to auto-forward messages to a queue. This has worked flawlessly for many months, but all of a sudden forwarding has stopped.

When I examine the subscription's MessageCountDetails, I can see the following:

ActiveMessageCount: 47
DeadLetterMessageCount: 0
ScheduledMessageCount: 0
TransferMessageCount: 0
TransferDeadLetterMessageCount: 0

The messages never get sent to the destination queue; what's wrong here and what can be done to fix it?

I am using a service bus relay and are receiving the following error

There is only one application connecting to the path, and for some reason the number of listeners has climbed to 25, but there is not 25 listeners.

During testing I am ending the program and likely not calling "close" on the end point, but I would have through that service bus would clean this up.  At any point in time there would only be one active listener on the end-point/path

I am not aware of a way of removing these end points, is there a way of clearing old dead listeners from a service bus?  This now means my service cannot run or connect, and I can't find a way to fix the issue.

System.ServiceModel.QuotaExceededException occurred
  HResult=-2146233087
  Message=MaximumListenersPerEndpoint:25. TrackingId:d79456b4-cf41-4d4e-aa0a-88ccc6b82417_G12,TimeStamp:6/11/2015 4:42:29 AM
  Source=Microsoft.ServiceBus
  StackTrace:
       at Microsoft.ServiceBus.RelayedOnewayListener.RelayedOnewayAmqpListenerClient.AmqpRelayedConnection.Open(TimeSpan timeout)
       at Microsoft.ServiceBus.RelayedOnewayListener.RelayedOnewayAmqpListenerClient.GetOrCreateConnection(Uri via, TimeSpan timeout)
       at Microsoft.ServiceBus.RelayedOnewayListener.RelayedOnewayAmqpListenerClient.Connect(TimeSpan timeout)
       at Microsoft.ServiceBus.RelayedOnewayTcpClient.EnsureConnected(TimeSpan timeout, Boolean isRetry)
       at Microsoft.ServiceBus.RelayedOnewayTcpClient.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
       at Microsoft.ServiceBus.RelayedOnewayListener.OnOpen(TimeSpan timeout)
       at Microsoft.ServiceBus.Channels.RefcountedCommunicationObject.Open(TimeSpan timeout)
       at Microsoft.ServiceBus.RelayedOnewayChannelListener.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
       at System.ServiceModel.Dispatcher.ChannelDispatcher.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
       at System.ServiceModel.ServiceHostBase.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
       at Microsoft.ServiceBus.RelayedSocketListener.Open(TimeSpan timeout)
       at Microsoft.ServiceBus.Channels.BufferedConnectionListener.Open(TimeSpan timeout)
       at Microsoft.ServiceBus.Channels.ConnectionAcceptor.Open(TimeSpan timeout)
       at Microsoft.ServiceBus.Channels.ConnectionDemuxer.StartDemuxing(TimeSpan timeout, OnViaDelegate viaDelegate)
       at Microsoft.ServiceBus.Channels.ConnectionDemuxer.Open(TimeSpan timeout)
       at Microsoft.ServiceBus.SocketConnectionTransportManager.OnOpen(TimeSpan timeout)
       at Microsoft.ServiceBus.Channels.TransportManager.Open(TimeSpan timeout, TransportChannelListener channelListener)
       at Microsoft.ServiceBus.Channels.TransportManagerContainer.Open(TimeSpan timeout, SelectTransportManagersCallback selectTransportManagerCallback)
       at Microsoft.ServiceBus.Channels.TransportChannelListener.OnOpen(TimeSpan timeout)
       at Microsoft.ServiceBus.Channels.ConnectionOrientedTransportChannelListener.OnOpen(TimeSpan timeout)
       at Microsoft.ServiceBus.SocketConnectionChannelListener`2.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
       at System.ServiceModel.Channels.ReliableChannelListenerBase`1.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.ReliableListenerOverDatagram`4.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
       at System.ServiceModel.Dispatcher.ChannelDispatcher.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
       at System.ServiceModel.ServiceHostBase.OnOpen(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout)
       at System.ServiceModel.Channels.CommunicationObject.Open()
       at ServiceBusManager.WCFEndPointManagement`2.StartServer()
  InnerException: Microsoft.ServiceBus.Messaging.Amqp.AmqpException
       HResult=-2146233088
       Message=MaximumListenersPerEndpoint:25. TrackingId:d79456b4-cf41-4d4e-aa0a-88ccc6b82417_G12,TimeStamp:6/11/2015 4:42:29 AM
       Source=Microsoft.ServiceBus
       StackTrace:
         Server stack trace:
         Exception rethrown at [0]:
            at Microsoft.ServiceBus.Common.ExceptionDispatcher.Throw(Exception exception)
            at Microsoft.ServiceBus.Common.AsyncResult.End[TAsyncResult](IAsyncResult result)
            at Microsoft.ServiceBus.Messaging.Amqp.AmqpObject.OpenAsyncResult.End(IAsyncResult result)
            at Microsoft.ServiceBus.Messaging.Amqp.AmqpObject.EndOpen(IAsyncResult result)
            at Microsoft.ServiceBus.Messaging.Amqp.DuplexAmqpLink.OnOperationComplete(AmqpObject link, IAsyncResult result, Boolean isOpen)
         Exception rethrown at [1]:
            at Microsoft.ServiceBus.Common.ExceptionDispatcher.Throw(Exception exception)
            at Microsoft.ServiceBus.Common.AsyncResult.End[TAsyncResult](IAsyncResult result)
            at Microsoft.ServiceBus.Messaging.Amqp.AmqpObject.OpenAsyncResult.End(IAsyncResult result)
            at Microsoft.ServiceBus.Messaging.Amqp.AmqpObject.EndOpen(IAsyncResult result)
            at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization)
       InnerException:

matvdl

Hi, I wanted to call senddata message using HTTP request, not with HTTPS

(Described here https://msdn.microsoft.com/en-in/library/azure/hh780786.aspx)

But able to do so, internally it is call https only, what to do?

Thanks.

Hi Folks,

I wanted to get information on one behavior I am seeing with the relay.

Context

We have a created a REST service and hosted it through the relay. Using fiddler I am sending in the request with content-type header as“application/octet-stream”with the UTF-16BE char in the bodyas below

On the server side I still see the stream of messagebody coming in as “UTF-8”.

Issue

While sending the message to relay we send UTF16-BE encoded message stream but when we are receiving it on the on-premise WCF service we get UTF8 encoded.

Has anyone ever seen encoding issues happening in the relay? If yes how did you resolve it?

Thanks

Tushar J

-Thanks TJ

At some point yesterday, both my Message Queues stopped receiving messages.  The error message I am getting is:

Batching brokered messages with distinct SessionId, PartitionKey, or MessageId  is not supported for an
entity with partitioning and duplicate detection enabled.
TrackingId:f4dbfe47-b164-4f42-8df2-bf0fae4de359_G5_B20,TimeStamp:6/11/2015 4:42:46 PM

Not sure how to tell if my queues are partitioned but I do know duplicate detection is on.  But this is not something that has ever changed on my end...

The API call I am using is QueueClient.SendBatch(), and I have not changed the SDK version on the code side either (it's been happily running in production for a while).

Any help would be appreciated.

Dear all,

I've installed windows service bus 1.1 on my server. I have six message containers and three nodes. On this bus, i creates many entities but one is the most important, it is the order queue for our ecommerce system.

After testing with high concurrency users, i see that the throughput of the bus is not as good as i expect. I check the message container database, the messages of order queue entity was contained only in one container db even we have six message container. I read on the msdn that the partition queue is supported for windows server bus 1.1. It means that even i add more and more servers, the throughput of our order queue doesn't increase. It's so terrible.

Could you tell me how to scale the windows service bus 1.1 to obtain high throughput?

Thank you so much!

http://www.wadewegner.com/2010/08/autostart-wcf-services-to-expose-them-as-service-bus-endpoints/

Not work, please help me.

My systems

IIS 8.5

App fabric 1.1