Quick tip: Sharing Power BI Dataflows

Problem

What rights does a user need to access a Power BI dataflow?

Just a quick post on Power BI dataflows after I saw this question on the Power BI Community forum about sharingdataflows - only via member/contributor permission?.

The user on the forum wants to know how to share dataflows with other users with the least privilege possible.

From my testing, it seems you need to provide people Contributor/Member/Admin to the workspace with the dataflow. If you choose the lowest permission Contributor - then they can't edit the dataflow BUT they can take over ownership and change the scheduling ! Not Good. I just want people to be able to connect to the dataflow.Have I missed anything ?

I thought this was just an easy lmgtfy-question, because there are already a lot of sources on dataflows:

• Matthew Roche (B | @SQLAllFather) wrote extensively about dataflows in Power BI, covering dataflows documentation, a whitepaper, Overview posts and much more.
• Reza Red wrote some good posts on dataflows with the use cases of dataflow being the best in my opinion.

Returning to finding the answer to this question, it turned out it wasn't that easy. There even is an open issue on the documentation on GitHub to add this information to the docs. So I ended up testing it myself.

Solution

To access a PowerBI dataflow you need either

• access to the workspace the dataflow resides in as an Admin, Member or Contributor, or
• Viewer role access to the workspace

Option 1, edit rights to the workspace, might not be desirable for your use case. But we have one other option: the new Viewer role that was introduced back in June of this year can also be used to share dataflows. I already wrote about the new Viewer role in PBI Desktop earlier.

When you are granted Viewer role access to a workspace where a dataflow is created, you can connect to and use that dataflow in Power BI Desktop:

Final thoughts

On a dataset you also have the ability to give the Build permission to give someone access to create content from that dataset (e.g. reports, dashboards, pinned tiles from Q&A, and Insights Discovery, but also content outside Power BI). This feature is still in preview however at the moment of writing. As the documentation says: Build permission is only relevant for datasets, for now? :-)

There is an idea that sounds like the Build permission on dataflows: Dataflow Permissions to give access to an individual dataflow.

Maybe the Build permission will also be added to dataflows in a later phase?

Power Query and The Curious Case of Keep Top Rows

The Power Query Editor in Power BI has many transformations that can be set from the UI. Keep Top Rows is one of them. I'd like to take you on my journey through this curious case I ran into a couple of weeks back when preparing for my session on Query Folding in Power BI.

Transformations in Power Query

Problem

I was preparing my demo's for my session at dataMinds Connect on Query Folding in Power BI (slides). If you're not familiar with query folding: transformations in Power Query are transformed into the native (data source) language and executed at the source for better performance. For a more thorough overview have a look at the post How Query Folding Works from Matt Allington (B | @ExceleratorBI).

If we look at SQL Server, some transformations can be folded (like Sorting, a simple Group By and Keep Top Rows), others cannot (merging two columns from the UI, using the Buffer() M-function and Keep Top Rows). See what I did there? :) Keep Top Rows on its own is a foldable transformation, it is (obviously) transformed into the TOP operator in SQL.

However, when using Keep Top Rows in combination with some other transformations it (looks like it) is not folding anymore. Your best chance is to use the View Native Query option in Power Query SQL Server Profiler to check if the query is folding or not. More on that later :)

A bit of contemplation: I do think the real use case of the Keep Top Rows transformation might be mostly in development environments, where you can limit the number of rows to import for example. I still think the findings were rather odd and worth sharing. So, let's have a look at how it works.

Setup

I used import mode for the Fact.Movement table from the WideWorldImportersDW database. I then added the Keep Top (100) Rows transformation in the Power Query Editor.

Keep Top Rows

As you can see it folds to SQL and all is good for now.

View Native Query with TOP 100

Adding transformations

Let's add a transformation on the Quantity column and apply an absolute value to it.

Add Absolute value of Quantity

So now the option to View Native Query is gone. Let's see if Power Query is speaking the truth (spoiler: No) 😀

I started SQL Server Profiler and captured the queries running against the database after I Close and Apply my changes. As you can see, now both the TOP operator and ABS function are folded.

SQL Server Profiler: TOP 100 and ABS

Now let's try something different and add a filter on the Date Key. Something strange has happened, because I already filtered the first 100 rows, so only 2 dates remained after that. But when I click on the Calculated Absolute Value query step I suddenly have a lot more dates that shouldn't be there in my opinion.

Filter on Date Key

Let's add a field from the Customer dimension this time and see what happens.

Expand Customer Dimension

The query for Fact.Movement is still the same, so the TOP operator and ABS function are still folding. And this is what is sent to the database for the Customer dimension:

SQL Server Profiler: Customer Dimension with WHERE clause

The Curious Case

Now watch closely to the where clause: so it actually already filters out the Customer Key based on the steps performed earlier in the Query Editor. But this Customer dimension is a separate query that returns 1 row, which will be joined to the other query inside Power Query.

Back to that WHERE clause: that Customer Key = 0 is valid for my (broken) Calculated Absolute Value query step, not for the Kept First 100 Rows as you see in the picture above. So I actually get the wrong a different result back into Power Query than I would expect.

I see you're thinking: "But you didn't add an explicit order, right?" So the top 100 is a little arbitrary. That's true, so let's add that order by.

Add Sorted Rows

This is a slightly better result in my opinion. Because now the Power Query steps are in sync with each other. The issue with View Native Query still remains the same by the way. It stops working at the Calculated Absolute Value query step, but the query send to the database is the following, so including the ABS function:

View Native Query after Sort

Recap

I showed several variations in the Power Query Editor of using Keep Top Rows and showed that adding subsequent steps brakes the View Native Query option in the editor, although query folding sometimes does take place. And adding an order to your query before applying a TOP operator is always a good idea, not only in SQL.

The steps I used might not all be best practices when creating a data model in Power BI. In case of the join to the customer dimension for example, it might be better to model it as a separate dimension, because STAR SCHEMA ALL THE THINGS. But I used those steps to highlight the problem.

Trying to make the STAR SCHEMA ALL THE THINGS into a meme. https://t.co/D7n6EfwuIS

— Koen Verbeeck (@Ko_Ver) October 24, 2019

I already mentioned this bug feature to Patrick and Adam (members of the Power BI CAT team) from Guy in a Cube (B | @GuyInACube) when I was at the Precon at Data Saturday Holland. Patrick LeBlanc (B | @patrickdba) also hadn't seen this before and hopeully will take it up with one of his team members. I thought I'd make a write up for him to easily reproduce it.

Speaking at dataMinds Connect in Belgium

I already posted a short update on LinkedIn, but I now finally also had the time to update my blog.

Query Folding in Power BI at dataMinds Connect

I had the honor of doing a session at the Newcomer track at dataMinds Connect. This was a special track for people like me that have (almost) no conference speaking experience. The conference assigned buddies to these newcomers. For that, I'd like to thank Koen Verbeeck (B | @Ko_Ver) for helping me enormously with feedback to and try-outs of my presentation.
My submission to this conference was actually the first I did earlier this year, after that I also submitted to the other places like SQL Saturday Prague. But this was actually my first technical session with lot's of demo's.

Slides on Github

The slides were already shared with the conference organizers, but are also available via my Speaking page. I recently made some changes to the way I share them because I moved all my talks and slides to my Github. I still have some things and links to add there, but the basics are there.

I also did some calculations on the feedback I received and I was pretty happy with the average of 3.9!

Feedback scores

Half marathon Eindhoven

Like I mentioned in my session at dataMinds Connect I also participated in the half marathon in Eindhoven on Sunday October 12.
As it was relatively warm with 24 degrees Celcius, I had to shelve my plans of running a PR fairly quickly after 5K. A lot of people also were struck by the warmth and humidity that day

Ouch, that was a heavy one.. hot and tough. No PR, but I DID finish it 👊 #runhappy pic.twitter.com/0cyPXiY6GU

— Nicky van Vroenhoven (@NickyvV) October 13, 2019

Power Platform World Tour in Dublin

The next stop is the Power Platform World Tour in Dublin where I'm presenting my Tips & Tricks of our Power BI implementation! I'm also doing one of the "Show & Tell" sessions at the Power Platform World Tour Meetup on the evening of October 30, organised by Ben Watt (B | @benrebooted).
I can also offer a $100 discount to all members who are part of their local Power Platform User Group community with the following code: 2019PPWT100DUB

NvV

Speaking at SQL Saturday Prague 2019

Last weekend I had the great opportunity of speaking at my first SQL Saturday, in the beautiful city of Prague in the Czech Republic. Together with my colleague Jeroen Schalken (B | @JeroenSchalken), we travelled to Prague to deliver our session on implementing Power BI (Premium) at Van Lanschot Kempen.

I also was very active on twitter during the weekend on the hashtag #sqlsatprague, I embedded every first tweet of my daily threads in the blog.

Friday

All settled and ready to go to #sqlsatprague with Jeroen Schalken! We are going to present the Tips & Tricks from our #PowerBI Implementation at Van Lanschot Kempen tomorrow at 17.15! #pbifamily https://t.co/6g7aGMQbDg

— Nicky van Vroenhoven (@NickyvV) September 20, 2019

We started Friday morning with our travel to Eindhoven Airport. After a little delay in Eindhoven, we were just in time to drop our bags at the hotel and get ready to be picked up for the speaker's dinner. It was in restaurant Kuchyň, with a beautiful view over the city next to Prague Castle.

Having a great speaker's dinner at #sqlsatprague! With @JeroenSchalken @JiriNeoral @pinaldave @christinaleo @Neil_Hambly @SQLSwimmer @tomaz_tsql @MatijaLah @sqlpass_cz @jardaminha @SQL_Alex @DejanSarka @DamianWidera @TomasTucek @jaroreken @malekpav pic.twitter.com/7gLfFy8Rkr

— Nicky van Vroenhoven (@NickyvV) September 20, 2019

We shared some starters on the table and then could pick our own food right from the kitchen, which was very nice. We were very well taken care of by the SQL Saturday Prague team!

Saturday

I started the SQL Saturday with a short run around the convention center and through the park and after having breakfast in the hotel we headed to the conference.

Rise and shine! It's #sqlsatprague time! pic.twitter.com/TLqGgG4apQ

— Nicky van Vroenhoven (@NickyvV) September 21, 2019

During the day I attended these sessions:

• Profiling Your Data by Angela Henry (B | @SQLSwimmer)
  Angela showed how you can use Power BI or the SSIS Data Profiling task (also available in Biml) to profile your data. Oh, and you should do that before the start of your project btw.
• Power BI Row Level Security Deep Dive by Jiří Neoral (B | @JiriNeoral)
  Jiri showed RLS in Desktop, from defining your security in a (hidden) table to dynamic RLS.
• Power BI as a universal analytic tool by Michal Chmelár (B)
  Michal showed several Cognitive Services for analyzing and translating text to sentiment analysis and also how to integrate the PowerApps visual into a Power BI report.
• Designing your tabular/PowerBI model for performance and scalability by Ivan Donev (B | @ikdonev)
  Ivan showed us several best practices of creating an SSAS model after breaking down Hash, Dictionary and Run Length Encoding.

There was also time for relaxing in the speaker room and taking some fresh air outside. And then finally of course our own session at the end of the day:

Tips and Tricks of a Power BI (Premium) Implementation at a Financial Institute by Jeroen Schalken and me. Because we were the latest slot of the day quite a few people already left, but our audience was very interactive and had lots of questions, so thank you!

We also went to restaurant Na Pekařce for the SQL Saturday after party, where we were joined by the speakers, organisers and also around 40 attendees.

Sunday

We had this day to enjoy the beautiful city of Prague, together with a few other speakers and Jarda, who was our awesome guide for the day!

Sightseeing after #sqlsatprague with @pinaldave @jardaminha @christinaleo @SQLSwimmer @JeroenSchalken pic.twitter.com/6Le9LbgYJo

— Nicky van Vroenhoven (@NickyvV) September 22, 2019

Monday

Because our flight was at 9.30 AM we started this day very early with a quick breakfast and on to the metro and bus to the check-in and security at the airport. It all went very smoothly so I even had some time to work on this post. At 11 o'clock we were back again on Dutch soil. As a surprise my wife and 2 youngest kids were there to pick me up.

Dobrý den: Final preparations before going back home from #sqlsatprague. Massive thanks to all the organisers @sqlpass_cz , sponsors, attendees and other speakers! A special thanks to @jardaminha for taking such good care of us and taking us on the sightseeing tour yesterday! pic.twitter.com/cXI4awH0Ah

— Nicky van Vroenhoven (@NickyvV) September 23, 2019

Closing words

All-in all it was a wonderfull weekend and I met many new great friends from the SQL Community. I hope I can some day go back to (SQL Saturday) Prague!

I also made a short video of my adventures during the weekend, so enjoy!